Max level shown:
1 [ Nov 9 02:46:17 Enabled. ]
2 [ Nov 9 02:46:17 Rereading configuration. ]
3 [ Nov 9 02:46:19 Rereading configuration. ]
4 [ Nov 9 02:46:30 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 9 02:46:31 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-09T02:46:31.236ZDEBGnexus: registered DTrace probes
82024-11-09T02:46:31.238ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-11-09T02:46:31.247ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-09T02:46:31.247ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-09T02:46:31.247ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-09T02:46:31.248ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-09T02:46:31.248ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-09T02:46:31.264ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-09T02:46:31.267ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-09T02:46:31.271ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-09T02:46:31.279ZDEBGnexus (ServerContext): registered USDT probes
672024-11-09T02:46:31.300ZINFOnexus: Database schema version is up to date desired_version = 113.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 113.0.0
682024-11-09T02:46:31.303ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
692024-11-09T02:46:31.308ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 894, tv_nsec: 650741835 } })
702024-11-09T02:46:31.309ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
712024-11-09T02:46:31.361ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
722024-11-09T02:46:31.361ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-09T02:46:31.365ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e71195d-79ff-4fca-985f-fb873372abee", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:31 GMT"} })
742024-11-09T02:46:31.365ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-09T02:46:31.366ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-09T02:46:31.397ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 894, tv_nsec: 739462458 } })
772024-11-09T02:46:31.397ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
782024-11-09T02:46:31.435ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
792024-11-09T02:46:31.435ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-09T02:46:31.435ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0332bf8c-c51f-429d-8d8f-e5da68fa6a48", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:31 GMT"} })
812024-11-09T02:46:31.435ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-09T02:46:31.436ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-09T02:46:31.508ZDEBGnexus (clickhouse-client): registered USDT probes id = a7a5ca92-2448-4a93-9cb5-f1b03570c09f
842024-11-09T02:46:31.508ZDEBGnexus (clickhouse-client): registered USDT probes id = a7a5ca92-2448-4a93-9cb5-f1b03570c09f
852024-11-09T02:46:31.519ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-09T02:46:31.529ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-09T02:46:31.536ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-09T02:46:31.537ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-09T02:46:31.538ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
912024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks
922024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate
932024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name}
942024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy
952024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy
962024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
972024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
982024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
992024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
1002024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
1012024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga
1022024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
1032024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all
1042024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
1052024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
1062024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import
1072024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate
1082024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target
1092024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target
1102024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled
1112024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1122024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id}
1132024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate
1142024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors
1152024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1162024-11-09T02:46:31.548ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers
1172024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1182024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge
1192024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled}
1202024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1212024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas
1222024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id}
1232024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id}
1242024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}
1252024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1262024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add
1272024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge
1282024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized
1292024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id}
1302024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id}
1312024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1322024-11-09T02:46:31.549ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:12221
1332024-11-09T02:46:31.549ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1342024-11-09T02:46:31.549ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352024-11-09T02:46:31.549ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1362024-11-09T02:46:31.566ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-11-09T02:46:31.566ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-11-09T02:46:31.568ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-11-09T02:46:31.569ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-11-09T02:46:31.569ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-11-09T02:46:31.569ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-11-09T02:46:31.587ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-11-09T02:46:31.587ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-11-09T02:46:31.589ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-11-09T02:46:31.589ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-11-09T02:46:31.589ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-11-09T02:46:31.589ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-11-09T02:46:31.623ZWARNnexus: Cannot look up rack: Object (of type ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29)) not found: rack file = nexus/src/app/rack.rs:774
1492024-11-09T02:46:31.995ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1502024-11-09T02:46:31.995ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-11-09T02:46:31.997ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-11-09T02:46:31.997ZDEBGnexus (DataLoader): attempting to create built-in silos
1532024-11-09T02:46:31.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-11-09T02:46:31.997ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-11-09T02:46:32.090ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1562024-11-09T02:46:32.090ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-11-09T02:46:32.091ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-11-09T02:46:32.177ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-11-09T02:46:32.179ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-11-09T02:46:32.179ZDEBGnexus (DataLoader): attempting to create built-in projects
1612024-11-09T02:46:32.179ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-11-09T02:46:32.179ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-11-09T02:46:32.209ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-09T02:46:32.210ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-09T02:46:32.266ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-11-09T02:46:32.266ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-11-09T02:46:32.298ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-11-09T02:46:32.301ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1692024-11-09T02:46:32.301ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702024-11-09T02:46:32.301ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1712024-11-09T02:46:32.338ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-11-09T02:46:32.338ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732024-11-09T02:46:32.405ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-11-09T02:46:32.406ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1752024-11-09T02:46:32.406ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-11-09T02:46:32.407ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-11-09T02:46:32.434ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1782024-11-09T02:46:32.434ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-11-09T02:46:32.435ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-11-09T02:46:32.435ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1812024-11-09T02:46:32.435ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-11-09T02:46:32.435ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-11-09T02:46:32.440ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-11-09T02:46:32.440ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-11-09T02:46:32.443ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-11-09T02:46:32.443ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-11-09T02:46:32.481ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-11-09T02:46:32.481ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-11-09T02:46:32.483ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-11-09T02:46:32.483ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-11-09T02:46:32.485ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-09T02:46:32.489ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932024-11-09T02:46:32.489ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-11-09T02:46:32.489ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-11-09T02:46:32.491ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-11-09T02:46:32.491ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-11-09T02:46:32.494ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-11-09T02:46:32.495ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-11-09T02:46:32.497ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-11-09T02:46:32.500ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2012024-11-09T02:46:32.500ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-11-09T02:46:32.501ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-11-09T02:46:32.559ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-11-09T02:46:32.559ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-11-09T02:46:32.560ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-11-09T02:46:32.561ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-11-09T02:46:32.562ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-11-09T02:46:32.562ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-11-09T02:46:32.563ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-11-09T02:46:32.567ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2112024-11-09T02:46:32.567ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-11-09T02:46:32.567ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-11-09T02:46:32.570ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-11-09T02:46:32.570ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-11-09T02:46:32.572ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-11-09T02:46:32.572ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-11-09T02:46:32.574ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-11-09T02:46:32.574ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-11-09T02:46:32.575ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-11-09T02:46:32.575ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-11-09T02:46:32.577ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-11-09T02:46:32.577ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-11-09T02:46:32.578ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-11-09T02:46:32.578ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-11-09T02:46:32.579ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-11-09T02:46:32.580ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-11-09T02:46:32.581ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-11-09T02:46:32.584ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2292024-11-09T02:46:32.584ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-11-09T02:46:32.584ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-11-09T02:46:32.585ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-11-09T02:46:32.586ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-11-09T02:46:32.587ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-11-09T02:46:32.587ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-11-09T02:46:32.588ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-11-09T02:46:32.593ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2372024-11-09T02:46:32.593ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-11-09T02:46:32.593ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-11-09T02:46:32.632ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-11-09T02:46:32.632ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-11-09T02:46:32.633ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-11-09T02:46:32.634ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-11-09T02:46:32.635ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-11-09T02:46:32.635ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-11-09T02:46:32.636ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-11-09T02:46:32.640ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2472024-11-09T02:46:32.640ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-11-09T02:46:32.640ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-11-09T02:46:32.675ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2502024-11-09T02:46:32.675ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-11-09T02:46:32.675ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-11-09T02:46:32.677ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-11-09T02:46:32.678ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-11-09T02:46:32.680ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-11-09T02:46:32.680ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-11-09T02:46:32.682ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-11-09T02:46:32.682ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-11-09T02:46:32.688ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-11-09T02:46:32.688ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-11-09T02:46:32.690ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-11-09T02:46:32.690ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-11-09T02:46:32.692ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-11-09T02:46:32.695ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2642024-11-09T02:46:32.695ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-11-09T02:46:32.695ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-11-09T02:46:32.696ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-11-09T02:46:32.697ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-11-09T02:46:32.698ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-11-09T02:46:32.698ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-11-09T02:46:32.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-11-09T02:46:32.702ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2722024-11-09T02:46:32.702ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-11-09T02:46:32.702ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-11-09T02:46:32.749ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-11-09T02:46:32.750ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-11-09T02:46:32.751ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-11-09T02:46:32.751ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-11-09T02:46:32.753ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-11-09T02:46:32.753ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-11-09T02:46:32.754ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-11-09T02:46:32.757ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2822024-11-09T02:46:32.757ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-11-09T02:46:32.757ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-11-09T02:46:32.833ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2852024-11-09T02:46:32.833ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2862024-11-09T02:46:32.833ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-11-09T02:46:32.833ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-11-09T02:46:32.844ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-11-09T02:46:32.845ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-11-09T02:46:32.846ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-11-09T02:46:32.847ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-11-09T02:46:32.848ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-11-09T02:46:32.848ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-11-09T02:46:32.850ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-09T02:46:32.850ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-11-09T02:46:32.851ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-11-09T02:46:32.851ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-11-09T02:46:32.852ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-09T02:46:32.855ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3002024-11-09T02:46:32.855ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-09T02:46:32.855ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-09T02:46:32.858ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-09T02:46:32.858ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-11-09T02:46:32.859ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-09T02:46:32.859ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-09T02:46:32.861ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-09T02:46:32.861ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-11-09T02:46:32.865ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-09T02:46:32.865ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-09T02:46:32.866ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-09T02:46:32.866ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-11-09T02:46:32.867ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-09T02:46:32.868ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-11-09T02:46:32.869ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-11-09T02:46:32.873ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3162024-11-09T02:46:32.873ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-11-09T02:46:32.873ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-11-09T02:46:32.874ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-09T02:46:32.874ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-09T02:46:32.876ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-09T02:46:32.876ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-11-09T02:46:32.877ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-09T02:46:32.878ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-09T02:46:32.879ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-11-09T02:46:32.879ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-11-09T02:46:32.881ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-11-09T02:46:32.881ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-11-09T02:46:32.882ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-11-09T02:46:32.883ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302024-11-09T02:46:32.883ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-11-09T02:46:32.887ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3322024-11-09T02:46:32.887ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-11-09T02:46:32.887ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-11-09T02:46:32.893ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-11-09T02:46:32.893ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-11-09T02:46:32.895ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-11-09T02:46:32.895ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-11-09T02:46:32.896ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-11-09T02:46:32.896ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-11-09T02:46:32.898ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-11-09T02:46:32.898ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422024-11-09T02:46:32.899ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-11-09T02:46:32.899ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-11-09T02:46:32.900ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-11-09T02:46:32.900ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-11-09T02:46:32.904ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-11-09T02:46:32.908ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3482024-11-09T02:46:32.908ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3492024-11-09T02:46:32.908ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3502024-11-09T02:46:32.908ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-11-09T02:46:32.909ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-11-09T02:46:32.909ZDEBGnexus (DataLoader): attempting to create silo users
3532024-11-09T02:46:32.909ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-11-09T02:46:32.909ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-11-09T02:46:32.917ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3562024-11-09T02:46:32.917ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3572024-11-09T02:46:32.917ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582024-11-09T02:46:32.917ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3592024-11-09T02:46:32.922ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3602024-11-09T02:46:32.922ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-11-09T02:46:32.922ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-11-09T02:46:32.927ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-11-09T02:46:32.927ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-11-09T02:46:32.987ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-11-09T02:46:32.988ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662024-11-09T02:46:32.989ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-11-09T02:46:32.990ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3682024-11-09T02:46:32.990ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-11-09T02:46:32.990ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-11-09T02:46:32.996ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-11-09T02:46:32.996ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-11-09T02:46:32.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-11-09T02:46:32.998ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3742024-11-09T02:46:32.998ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-11-09T02:46:32.998ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3762024-11-09T02:46:33.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-11-09T02:46:33.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782024-11-09T02:46:33.162ZINFOnexus: populate complete file = nexus/src/app/mod.rs:538
3792024-11-09T02:46:33.162ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:547
3802024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3812024-11-09T02:46:33.165ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3822024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3832024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
3842024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3852024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3862024-11-09T02:46:33.165ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3872024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3882024-11-09T02:46:33.165ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
3892024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3902024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3912024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3922024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3932024-11-09T02:46:33.165ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3942024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3952024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3962024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3972024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3982024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3992024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4002024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4012024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4022024-11-09T02:46:33.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4032024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4042024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4052024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4062024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4072024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4082024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4092024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4102024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4112024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4122024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4132024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4142024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4152024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4162024-11-09T02:46:33.166ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4172024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4182024-11-09T02:46:33.166ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:36:33.166051671 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4192024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4202024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 561.022\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4212024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 535.46\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4222024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.018941ms iteration = 1 status = {"error":"no blueprint"}
4232024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4242024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4252024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4262024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 99.052\u{b5}s iteration = 1 status = {"errors":[],"records_set_to_done":[]}
4272024-11-09T02:46:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 149.944\u{b5}s iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
4282024-11-09T02:46:33.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4292024-11-09T02:46:33.168ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4302024-11-09T02:46:33.170ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4312024-11-09T02:46:33.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4322024-11-09T02:46:33.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4332024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4342024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4352024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4362024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4372024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4382024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4392024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4402024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 245.385\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4412024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4422024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4432024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4442024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.434994ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4452024-11-09T02:46:33.173ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4462024-11-09T02:46:33.173ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4472024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4482024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4492024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4502024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4512024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.693049ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4522024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4532024-11-09T02:46:33.174ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4542024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4552024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4562024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4572024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4582024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4592024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4602024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4612024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4622024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4632024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4642024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4652024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4662024-11-09T02:46:33.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 516330979 } })
4672024-11-09T02:46:33.174ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 516327129 } })
4682024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4692024-11-09T02:46:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4702024-11-09T02:46:33.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.519797ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4712024-11-09T02:46:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4722024-11-09T02:46:33.177ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4732024-11-09T02:46:33.177ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4742024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 11.091439ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4752024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 11.379855ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4762024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4772024-11-09T02:46:33.177ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4782024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 4.871\u{b5}s iteration = 2 status = {"error":"no config"}
4792024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4802024-11-09T02:46:33.177ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4812024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.03\u{b5}s iteration = 2 status = {"error":"no config"}
4822024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4832024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4842024-11-09T02:46:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4852024-11-09T02:46:33.178ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4862024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4872024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4882024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4892024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4902024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4912024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4922024-11-09T02:46:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4932024-11-09T02:46:33.185ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942024-11-09T02:46:33.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4952024-11-09T02:46:33.188ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4962024-11-09T02:46:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4972024-11-09T02:46:33.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4982024-11-09T02:46:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4992024-11-09T02:46:33.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002024-11-09T02:46:33.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5012024-11-09T02:46:33.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5022024-11-09T02:46:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5032024-11-09T02:46:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5042024-11-09T02:46:33.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-11-09T02:46:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5062024-11-09T02:46:33.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5072024-11-09T02:46:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5082024-11-09T02:46:33.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5092024-11-09T02:46:33.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5102024-11-09T02:46:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5112024-11-09T02:46:33.207ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 549471754 } })
5122024-11-09T02:46:33.208ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
5132024-11-09T02:46:33.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5142024-11-09T02:46:33.210ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5162024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5172024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5182024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5192024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5202024-11-09T02:46:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5212024-11-09T02:46:33.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222024-11-09T02:46:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5232024-11-09T02:46:33.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5242024-11-09T02:46:33.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5252024-11-09T02:46:33.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5262024-11-09T02:46:33.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5272024-11-09T02:46:33.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282024-11-09T02:46:33.238ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5292024-11-09T02:46:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5302024-11-09T02:46:33.240ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:36:33.166051671 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5312024-11-09T02:46:33.240ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 74.50867ms iteration = 1 status = {"expiration":"2024-11-09T02:36:33.166051671Z","pruned":[]}
5322024-11-09T02:46:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5332024-11-09T02:46:33.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 596118578 } })
5342024-11-09T02:46:33.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
5352024-11-09T02:46:33.255ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
5362024-11-09T02:46:33.255ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 89.538591ms iteration = 1 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
5372024-11-09T02:46:33.261ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 95.523744ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5382024-11-09T02:46:33.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5392024-11-09T02:46:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5402024-11-09T02:46:33.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
5412024-11-09T02:46:33.267ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5422024-11-09T02:46:33.268ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09f7887f-6110-4a78-b490-ad719697208d", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
5432024-11-09T02:46:33.273ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5442024-11-09T02:46:33.274ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5452024-11-09T02:46:33.283ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5462024-11-09T02:46:33.283ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.345445ms iteration = 1 status = {"error":"inventory collection is None"}
5472024-11-09T02:46:33.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482024-11-09T02:46:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5492024-11-09T02:46:33.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5502024-11-09T02:46:33.293ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5512024-11-09T02:46:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5522024-11-09T02:46:33.293ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 635640875 } })
5532024-11-09T02:46:33.297ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5542024-11-09T02:46:33.298ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 131.823475ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5552024-11-09T02:46:33.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562024-11-09T02:46:33.307ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5572024-11-09T02:46:33.307ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5582024-11-09T02:46:33.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5592024-11-09T02:46:33.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5602024-11-09T02:46:33.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-11-09T02:46:33.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5622024-11-09T02:46:33.314ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5632024-11-09T02:46:33.314ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5642024-11-09T02:46:33.314ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 147.928837ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5652024-11-09T02:46:33.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5662024-11-09T02:46:33.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5672024-11-09T02:46:33.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-11-09T02:46:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5692024-11-09T02:46:33.319ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 153.371069ms iteration = 1 status = {}
5702024-11-09T02:46:33.320ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5712024-11-09T02:46:33.320ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 154.496903ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5722024-11-09T02:46:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5732024-11-09T02:46:33.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5742024-11-09T02:46:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5752024-11-09T02:46:33.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-11-09T02:46:33.321ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-11-09T02:46:33.322ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5782024-11-09T02:46:33.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 156.220438ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5792024-11-09T02:46:33.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5802024-11-09T02:46:33.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5812024-11-09T02:46:33.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5822024-11-09T02:46:33.324ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5832024-11-09T02:46:33.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5842024-11-09T02:46:33.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5852024-11-09T02:46:33.328ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5862024-11-09T02:46:33.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5872024-11-09T02:46:33.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5882024-11-09T02:46:33.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5892024-11-09T02:46:33.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5902024-11-09T02:46:33.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5912024-11-09T02:46:33.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5922024-11-09T02:46:33.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5932024-11-09T02:46:33.334ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5942024-11-09T02:46:33.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5952024-11-09T02:46:33.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5962024-11-09T02:46:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5972024-11-09T02:46:33.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5982024-11-09T02:46:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5992024-11-09T02:46:33.349ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6002024-11-09T02:46:33.349ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6012024-11-09T02:46:33.350ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cba13707-cd98-4040-87ed-85261f6975e4", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6022024-11-09T02:46:33.350ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6032024-11-09T02:46:33.351ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6042024-11-09T02:46:33.351ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 185.30469ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6052024-11-09T02:46:33.353ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6062024-11-09T02:46:33.361ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6072024-11-09T02:46:33.361ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 196.056002ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6082024-11-09T02:46:33.367ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6092024-11-09T02:46:33.367ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 201.457004ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6102024-11-09T02:46:33.367ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6112024-11-09T02:46:33.367ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6122024-11-09T02:46:33.367ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6132024-11-09T02:46:33.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6142024-11-09T02:46:33.371ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6152024-11-09T02:46:33.371ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d072e720-ac6d-48ab-965b-2e70aea78fba", "content-length": "1", "date": "Sat, 09 Nov 2024 02:46:32 GMT"} })
6162024-11-09T02:46:33.376ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6172024-11-09T02:46:33.376ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6182024-11-09T02:46:33.376ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6192024-11-09T02:46:33.376ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 210.589072ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6202024-11-09T02:46:33.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6212024-11-09T02:46:33.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 212.608303ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6222024-11-09T02:46:33.381ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.510014ms iteration = 1 status = null
6232024-11-09T02:46:33.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6242024-11-09T02:46:33.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6252024-11-09T02:46:33.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6262024-11-09T02:46:33.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6272024-11-09T02:46:33.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 230.924051ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6282024-11-09T02:46:33.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6292024-11-09T02:46:33.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6302024-11-09T02:46:33.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6312024-11-09T02:46:33.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6322024-11-09T02:46:33.405ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6332024-11-09T02:46:33.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6342024-11-09T02:46:33.407ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6352024-11-09T02:46:33.407ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6362024-11-09T02:46:33.408ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6372024-11-09T02:46:33.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6382024-11-09T02:46:33.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6392024-11-09T02:46:33.408ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6402024-11-09T02:46:33.408ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6412024-11-09T02:46:33.408ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 243.021882ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6422024-11-09T02:46:33.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6432024-11-09T02:46:33.410ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "36a810ae-421f-429a-9aed-c1c07aeb5929", "content-length": "476", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6442024-11-09T02:46:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6452024-11-09T02:46:33.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6462024-11-09T02:46:33.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6472024-11-09T02:46:33.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6482024-11-09T02:46:33.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6492024-11-09T02:46:33.416ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6502024-11-09T02:46:33.416ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcccd0f6-5b8d-4956-8ec3-6ff852ba1e1f", "content-length": "734", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6512024-11-09T02:46:33.419ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6522024-11-09T02:46:33.420ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad6fbe99-f2b1-45e5-bd68-00570b2ce268", "content-length": "111", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6532024-11-09T02:46:33.420ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6542024-11-09T02:46:33.420ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c25948-5baa-4658-a0ed-a1987103d77c", "content-length": "111", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6552024-11-09T02:46:33.420ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6562024-11-09T02:46:33.421ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ef1d9a-23ff-4a95-a32f-5c5eb5d84c76", "content-length": "167", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6572024-11-09T02:46:33.421ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6582024-11-09T02:46:33.421ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d10f03f4-f0e6-4546-8531-4cd4e536f15d", "content-length": "167", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6592024-11-09T02:46:33.421ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6602024-11-09T02:46:33.421ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5adbbc34-5447-4560-b300-8a0345f12384", "content-length": "175", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6612024-11-09T02:46:33.421ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6622024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad8a78b0-251d-4c52-827e-67a3f86c50b8", "content-length": "175", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6632024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6642024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "034b596b-1687-4081-92dc-ea1c4e5cfb43", "content-length": "702", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6652024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6662024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c246390-d14d-4c37-870d-6fa0d54a4a84", "content-length": "727", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6672024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6682024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "866557ac-0342-4507-bb3c-05c0805492fa", "content-length": "729", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6692024-11-09T02:46:33.422ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6702024-11-09T02:46:33.423ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ce404ba-5488-4391-9c03-40255a553d27", "content-length": "728", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6712024-11-09T02:46:33.423ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6722024-11-09T02:46:33.423ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "da8532f9-5a10-491b-820a-88d6a6139ea0", "content-length": "722", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6732024-11-09T02:46:33.423ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6742024-11-09T02:46:33.423ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d4bbb62-c5c9-4981-b929-acaa0614f9f6", "content-length": "109", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6752024-11-09T02:46:33.423ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6762024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aecb1aac-3a5a-41c1-87fb-04b0f305e99b", "content-length": "109", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6772024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6782024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "747b1ba9-31a0-45ff-9c4e-9c186d4010f1", "content-length": "169", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6792024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6802024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1408e2e1-eb01-45c5-947a-8af5eb4d1838", "content-length": "169", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6812024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6822024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f411ce4e-ff65-4158-8283-76d554576fb3", "content-length": "178", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6832024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6842024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "db578c6e-00df-4c19-ae01-4f7bbfd41733", "content-length": "178", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6852024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6862024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c644d92c-33ef-45a6-a34f-efbfbee1b99e", "content-length": "702", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6872024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6882024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "28176fb3-2fe4-45fa-b084-145eba989609", "content-length": "727", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6892024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6902024-11-09T02:46:33.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ed4915e-f39c-4281-95f8-1a3099e2d1c8", "content-length": "729", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6912024-11-09T02:46:33.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6922024-11-09T02:46:33.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "288be4f5-9969-4c22-aa22-32e7d523f19b", "content-length": "728", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6932024-11-09T02:46:33.426ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6942024-11-09T02:46:33.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6952024-11-09T02:46:33.428ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 262.25176ms iteration = 1 status = {}
6962024-11-09T02:46:33.428ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6972024-11-09T02:46:33.430ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 264.505955ms iteration = 1 status = {}
6982024-11-09T02:46:33.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
6992024-11-09T02:46:33.430ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7002024-11-09T02:46:33.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7012024-11-09T02:46:33.431ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-11-09T02:46:33.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7032024-11-09T02:46:33.433ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7042024-11-09T02:46:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7052024-11-09T02:46:33.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7062024-11-09T02:46:33.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7072024-11-09T02:46:33.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7082024-11-09T02:46:33.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7092024-11-09T02:46:33.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7102024-11-09T02:46:33.469ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7112024-11-09T02:46:33.469ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 303.094024ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7122024-11-09T02:46:33.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7132024-11-09T02:46:33.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7142024-11-09T02:46:33.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7152024-11-09T02:46:33.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7162024-11-09T02:46:33.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7172024-11-09T02:46:33.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7182024-11-09T02:46:33.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7192024-11-09T02:46:33.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7202024-11-09T02:46:33.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7212024-11-09T02:46:33.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7222024-11-09T02:46:33.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7232024-11-09T02:46:33.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7242024-11-09T02:46:33.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7252024-11-09T02:46:33.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7262024-11-09T02:46:33.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7272024-11-09T02:46:33.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282024-11-09T02:46:33.500ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7292024-11-09T02:46:33.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7302024-11-09T02:46:33.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7312024-11-09T02:46:33.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7322024-11-09T02:46:33.501ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7332024-11-09T02:46:33.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7342024-11-09T02:46:33.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7352024-11-09T02:46:33.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362024-11-09T02:46:33.503ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-11-09T02:46:33.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-11-09T02:46:33.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-11-09T02:46:33.505ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7402024-11-09T02:46:33.505ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7412024-11-09T02:46:33.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-11-09T02:46:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7432024-11-09T02:46:33.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7442024-11-09T02:46:33.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-11-09T02:46:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-11-09T02:46:33.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7472024-11-09T02:46:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7482024-11-09T02:46:33.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492024-11-09T02:46:33.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7502024-11-09T02:46:33.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7512024-11-09T02:46:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7522024-11-09T02:46:33.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532024-11-09T02:46:33.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7542024-11-09T02:46:33.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7552024-11-09T02:46:33.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7562024-11-09T02:46:33.522ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 356.842994ms iteration = 1 status = {}
7572024-11-09T02:46:33.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-11-09T02:46:33.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-11-09T02:46:33.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7602024-11-09T02:46:33.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612024-11-09T02:46:33.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-11-09T02:46:33.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-11-09T02:46:33.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-11-09T02:46:33.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-11-09T02:46:33.533ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-11-09T02:46:33.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-11-09T02:46:33.535ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682024-11-09T02:46:33.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692024-11-09T02:46:33.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702024-11-09T02:46:33.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-11-09T02:46:33.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7722024-11-09T02:46:33.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7732024-11-09T02:46:33.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742024-11-09T02:46:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752024-11-09T02:46:33.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762024-11-09T02:46:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772024-11-09T02:46:33.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7782024-11-09T02:46:33.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7792024-11-09T02:46:33.549ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802024-11-09T02:46:33.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7812024-11-09T02:46:33.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7822024-11-09T02:46:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7832024-11-09T02:46:33.577ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7842024-11-09T02:46:33.578ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7852024-11-09T02:46:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7862024-11-09T02:46:33.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872024-11-09T02:46:33.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7882024-11-09T02:46:33.582ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892024-11-09T02:46:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902024-11-09T02:46:33.594ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7912024-11-09T02:46:33.594ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7922024-11-09T02:46:33.594ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7932024-11-09T02:46:33.624ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7942024-11-09T02:46:33.624ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7952024-11-09T02:46:33.626ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7962024-11-09T02:46:33.626ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7972024-11-09T02:46:33.628ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982024-11-09T02:46:33.631ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
7992024-11-09T02:46:33.631ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
8002024-11-09T02:46:33.684ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8012024-11-09T02:46:33.684ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8022024-11-09T02:46:33.684ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8032024-11-09T02:46:33.685ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 516.178727ms
8042024-11-09T02:46:33.685ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 518.970954ms iteration = 1 status = {}
8052024-11-09T02:46:33.886ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = aee3d201-e34c-48bf-ac54-35a88124914c file = nexus/db-queries/src/db/datastore/inventory.rs:1000
8062024-11-09T02:46:33.886ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = aee3d201-e34c-48bf-ac54-35a88124914c time_started = 2024-11-09 02:46:33.407338 UTC
8072024-11-09T02:46:33.886ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 720.765945ms iteration = 1 status = {"collection_id":"aee3d201-e34c-48bf-ac54-35a88124914c","time_done":"2024-11-09 02:46:33.500072 UTC","time_started":"2024-11-09 02:46:33.407338 UTC"}
8082024-11-09T02:46:33.886ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8092024-11-09T02:46:33.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8102024-11-09T02:46:33.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8112024-11-09T02:46:33.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8122024-11-09T02:46:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8132024-11-09T02:46:33.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8142024-11-09T02:46:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8152024-11-09T02:46:33.892ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
8162024-11-09T02:46:33.892ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.961643ms iteration = 2 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
8172024-11-09T02:46:35.632ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8182024-11-09T02:46:35.632ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8192024-11-09T02:46:35.634ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8202024-11-09T02:46:35.634ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8212024-11-09T02:46:35.636ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8222024-11-09T02:46:35.638ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8232024-11-09T02:46:35.638ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8242024-11-09T02:46:37.639ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8252024-11-09T02:46:37.640ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8262024-11-09T02:46:37.641ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8272024-11-09T02:46:37.641ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8282024-11-09T02:46:37.643ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292024-11-09T02:46:37.646ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8302024-11-09T02:46:37.646ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8312024-11-09T02:46:39.647ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8322024-11-09T02:46:39.647ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8332024-11-09T02:46:39.649ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8342024-11-09T02:46:39.649ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8352024-11-09T02:46:39.651ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8362024-11-09T02:46:39.653ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8372024-11-09T02:46:39.653ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8382024-11-09T02:46:41.654ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8392024-11-09T02:46:41.654ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8402024-11-09T02:46:41.656ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8412024-11-09T02:46:41.656ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8422024-11-09T02:46:41.658ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432024-11-09T02:46:41.660ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8442024-11-09T02:46:41.660ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8452024-11-09T02:46:43.165ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
8462024-11-09T02:46:43.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8472024-11-09T02:46:43.165ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
8482024-11-09T02:46:43.165ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8492024-11-09T02:46:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8502024-11-09T02:46:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8512024-11-09T02:46:43.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8522024-11-09T02:46:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8532024-11-09T02:46:43.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8542024-11-09T02:46:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8552024-11-09T02:46:43.173ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
8562024-11-09T02:46:43.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.599507ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
8572024-11-09T02:46:43.194ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8582024-11-09T02:46:43.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8592024-11-09T02:46:43.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.157233ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8602024-11-09T02:46:43.661ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8612024-11-09T02:46:43.661ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8622024-11-09T02:46:43.663ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8632024-11-09T02:46:43.663ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8642024-11-09T02:46:43.664ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8652024-11-09T02:46:43.667ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8662024-11-09T02:46:43.667ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8672024-11-09T02:46:45.668ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8682024-11-09T02:46:45.669ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8692024-11-09T02:46:45.670ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8702024-11-09T02:46:45.670ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8712024-11-09T02:46:45.672ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8722024-11-09T02:46:45.675ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8732024-11-09T02:46:45.675ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8742024-11-09T02:46:47.676ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8752024-11-09T02:46:47.676ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8762024-11-09T02:46:47.678ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8772024-11-09T02:46:47.678ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8782024-11-09T02:46:47.679ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8792024-11-09T02:46:47.682ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8802024-11-09T02:46:47.682ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8812024-11-09T02:46:49.683ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8822024-11-09T02:46:49.683ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8832024-11-09T02:46:49.685ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8842024-11-09T02:46:49.685ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8852024-11-09T02:46:49.687ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862024-11-09T02:46:49.689ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8872024-11-09T02:46:49.689ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8882024-11-09T02:46:51.690ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8892024-11-09T02:46:51.690ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8902024-11-09T02:46:51.692ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8912024-11-09T02:46:51.692ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8922024-11-09T02:46:51.694ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-11-09T02:46:51.696ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
8942024-11-09T02:46:51.697ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8952024-11-09T02:46:53.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
8962024-11-09T02:46:53.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8972024-11-09T02:46:53.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
8982024-11-09T02:46:53.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8992024-11-09T02:46:53.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-11-09T02:46:53.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9012024-11-09T02:46:53.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-11-09T02:46:53.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9032024-11-09T02:46:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9042024-11-09T02:46:53.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.798838ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9052024-11-09T02:46:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9062024-11-09T02:46:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072024-11-09T02:46:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9082024-11-09T02:46:53.172ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9092024-11-09T02:46:53.172ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.475194ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9102024-11-09T02:46:53.697ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9112024-11-09T02:46:53.698ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9122024-11-09T02:46:53.699ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9132024-11-09T02:46:53.699ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9142024-11-09T02:46:53.701ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9152024-11-09T02:46:53.703ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
9162024-11-09T02:46:53.703ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9172024-11-09T02:46:55.705ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9182024-11-09T02:46:55.705ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9192024-11-09T02:46:55.707ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9202024-11-09T02:46:55.707ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9212024-11-09T02:46:55.708ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222024-11-09T02:46:55.711ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
9232024-11-09T02:46:55.711ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9242024-11-09T02:46:57.600ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61968
9252024-11-09T02:46:57.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 40d7a213-4ea6-4757-bc50-140e4267ba40 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9262024-11-09T02:46:57.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 40d7a213-4ea6-4757-bc50-140e4267ba40 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9272024-11-09T02:46:57.609ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:54858
9282024-11-09T02:46:57.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = e4832ddf-ef7c-41b4-9ab9-059b9cec3b15 roles = RoleSet { roles: {} } uri = /sled-agents/f032ba4a-ac68-41c0-a068-00d3371df648
9292024-11-09T02:46:57.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = e4832ddf-ef7c-41b4-9ab9-059b9cec3b15 resource = Database result = Ok(()) uri = /sled-agents/f032ba4a-ac68-41c0-a068-00d3371df648
9302024-11-09T02:46:57.613ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 3350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = e4832ddf-ef7c-41b4-9ab9-059b9cec3b15 response_code = 404 uri = /sled-agents/f032ba4a-ac68-41c0-a068-00d3371df648
9312024-11-09T02:46:57.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 62f288f2-2a67-4389-ba51-ae4cdc6205b8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
9322024-11-09T02:46:57.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 40d7a213-4ea6-4757-bc50-140e4267ba40 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9332024-11-09T02:46:57.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 62f288f2-2a67-4389-ba51-ae4cdc6205b8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
9342024-11-09T02:46:57.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 62f288f2-2a67-4389-ba51-ae4cdc6205b8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
9352024-11-09T02:46:57.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = b0705b80-637d-4f31-b348-bb35777177fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9362024-11-09T02:46:57.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = b0705b80-637d-4f31-b348-bb35777177fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9372024-11-09T02:46:57.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = b0705b80-637d-4f31-b348-bb35777177fa response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9382024-11-09T02:46:57.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 6d097da9-4bff-47bf-beb2-69d242bd17db roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9392024-11-09T02:46:57.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 6d097da9-4bff-47bf-beb2-69d242bd17db resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9402024-11-09T02:46:57.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 6d097da9-4bff-47bf-beb2-69d242bd17db response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9412024-11-09T02:46:57.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 7ccf4e98-7674-4196-955f-7bc745893000 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9422024-11-09T02:46:57.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 7ccf4e98-7674-4196-955f-7bc745893000 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9432024-11-09T02:46:57.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 7ccf4e98-7674-4196-955f-7bc745893000 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9442024-11-09T02:46:57.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 32c281db-b75e-460b-885a-da0c785578da roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9452024-11-09T02:46:57.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 32c281db-b75e-460b-885a-da0c785578da resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9462024-11-09T02:46:57.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 32c281db-b75e-460b-885a-da0c785578da response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9472024-11-09T02:46:57.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ab5d3f56-1d64-4c30-890a-061dbaf2b501 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9482024-11-09T02:46:57.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ab5d3f56-1d64-4c30-890a-061dbaf2b501 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9492024-11-09T02:46:57.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ab5d3f56-1d64-4c30-890a-061dbaf2b501 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9502024-11-09T02:46:57.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a0e6810f-ff14-48b0-abf3-fb9308ed5d9e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9512024-11-09T02:46:57.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a0e6810f-ff14-48b0-abf3-fb9308ed5d9e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9522024-11-09T02:46:57.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a0e6810f-ff14-48b0-abf3-fb9308ed5d9e response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9532024-11-09T02:46:57.712ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9542024-11-09T02:46:57.712ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9552024-11-09T02:46:57.713ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9562024-11-09T02:46:57.714ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9572024-11-09T02:46:57.715ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582024-11-09T02:46:57.717ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
9592024-11-09T02:46:57.717ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9602024-11-09T02:46:58.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 2b924998-5719-436e-8c89-228e5eb1abf1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
9612024-11-09T02:46:58.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 2b924998-5719-436e-8c89-228e5eb1abf1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
9622024-11-09T02:46:58.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 2b924998-5719-436e-8c89-228e5eb1abf1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
9632024-11-09T02:46:59.078ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = f032ba4a-ac68-41c0-a068-00d3371df648
9642024-11-09T02:46:59.096ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
9652024-11-09T02:46:59.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22638 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54858 req_id = 2f4c0eaa-7887-4b64-819d-758119316259 response_code = 204 uri = /sled-agents/f032ba4a-ac68-41c0-a068-00d3371df648
9662024-11-09T02:46:59.096ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9672024-11-09T02:46:59.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9682024-11-09T02:46:59.098ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9692024-11-09T02:46:59.100ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9702024-11-09T02:46:59.100ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9712024-11-09T02:46:59.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9722024-11-09T02:46:59.117ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(babcbb52-0146-4325-bd58-0bf30cabbe14, 0), (bb5f090b-6d54-48ce-bdc0-b8acfa4298d5, 0), (aee3d201-e34c-48bf-ac54-35a88124914c, 0)]
9732024-11-09T02:46:59.118ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 922, tv_nsec: 458793126 } })
9742024-11-09T02:46:59.148ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
9752024-11-09T02:46:59.148ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
9762024-11-09T02:46:59.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
9772024-11-09T02:46:59.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "78db9eb4-5144-435a-8e2b-1640e4bd4e11", "content-length": "476", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9782024-11-09T02:46:59.149ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
9792024-11-09T02:46:59.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "598a8f4c-1237-450d-ace3-f6b6d26e9300", "content-length": "734", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9802024-11-09T02:46:59.149ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
9812024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd6c8c0-3af3-444f-b6e3-035c7aa1b485", "content-length": "111", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9822024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
9832024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5985d32a-206c-4878-9152-86a197651649", "content-length": "111", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9842024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
9852024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b682d09d-35f8-4eab-bccc-f968f3850046", "content-length": "167", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9862024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
9872024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c009e1f-8226-4ca4-928a-b5d216388922", "content-length": "167", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9882024-11-09T02:46:59.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
9892024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e8b177c-a539-4e76-a077-43733957e66c", "content-length": "175", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9902024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
9912024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6b436e6-a35d-4775-af26-1c8cad3644d6", "content-length": "175", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9922024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
9932024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "41226ae8-ffe3-447d-bf67-165923905676", "content-length": "702", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9942024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9952024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd5191c-8bde-41cb-9f9c-2d67a9066e3a", "content-length": "727", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9962024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9972024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04d7d1dc-bf9d-43af-84eb-834f88045827", "content-length": "729", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
9982024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9992024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a0acbc4-b533-4b2a-a0fd-39b4f2689c0c", "content-length": "728", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10002024-11-09T02:46:59.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
10012024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a505e1ef-d49c-459e-abc8-a4cfc7dc5891", "content-length": "722", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10022024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
10032024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "adc92d12-17f2-4d47-8a8c-96d69cecbc81", "content-length": "109", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10042024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
10052024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b09fc1c2-4369-4101-8a62-902dc5a58320", "content-length": "109", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10062024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
10072024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1b1fc01-cf8c-4722-8ac9-8f74b0aca27d", "content-length": "169", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10082024-11-09T02:46:59.152ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
10092024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d02c8a9e-bd1e-4c43-8c0b-cd51f60ef3ee", "content-length": "169", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10102024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
10112024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb23abd4-90f9-4775-afad-65cdb73d991b", "content-length": "178", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10122024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
10132024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2833c651-2a66-4459-aad1-7a0a2402251f", "content-length": "178", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10142024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
10152024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4327f78-9018-47b3-a426-c35fcc0f2799", "content-length": "702", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10162024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10172024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fc99282-40ff-436f-a92e-e593aa4d200d", "content-length": "727", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10182024-11-09T02:46:59.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10192024-11-09T02:46:59.154ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e101f4d-c81d-49f2-a83d-afc1631ea25e", "content-length": "729", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10202024-11-09T02:46:59.154ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10212024-11-09T02:46:59.154ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea5ca13f-7fbb-45b0-9c68-d33b8a75210d", "content-length": "728", "date": "Sat, 09 Nov 2024 02:46:58 GMT"} })
10222024-11-09T02:46:59.154ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10232024-11-09T02:46:59.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10242024-11-09T02:46:59.155ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10252024-11-09T02:46:59.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10262024-11-09T02:46:59.157ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10272024-11-09T02:46:59.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10282024-11-09T02:46:59.159ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292024-11-09T02:46:59.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10302024-11-09T02:46:59.161ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10312024-11-09T02:46:59.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10322024-11-09T02:46:59.194ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
10332024-11-09T02:46:59.194ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
10342024-11-09T02:46:59.392ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f455f05-79d3-45f7-b682-7fa74004ef5d", "content-length": "29179", "date": "Sat, 09 Nov 2024 02:46:59 GMT"} })
10352024-11-09T02:46:59.393ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10362024-11-09T02:46:59.395ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10372024-11-09T02:46:59.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10382024-11-09T02:46:59.397ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392024-11-09T02:46:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10402024-11-09T02:46:59.399ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10412024-11-09T02:46:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10422024-11-09T02:46:59.499ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44433
10432024-11-09T02:46:59.604ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = ae7eda3c-463c-4531-b460-1654db48aec5 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
10442024-11-09T02:46:59.605ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = ae7eda3c-463c-4531-b460-1654db48aec5 time_started = 2024-11-09 02:46:59.148930 UTC
10452024-11-09T02:46:59.605ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 508.130472ms iteration = 2 status = {"collection_id":"ae7eda3c-463c-4531-b460-1654db48aec5","time_done":"2024-11-09 02:46:59.393818 UTC","time_started":"2024-11-09 02:46:59.148930 UTC"}
10462024-11-09T02:46:59.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
10472024-11-09T02:46:59.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10482024-11-09T02:46:59.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10492024-11-09T02:46:59.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10502024-11-09T02:46:59.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10512024-11-09T02:46:59.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10522024-11-09T02:46:59.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10532024-11-09T02:46:59.611ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
10542024-11-09T02:46:59.611ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.579686ms iteration = 3 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
10552024-11-09T02:46:59.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90d3f963-3656-4e5d-9b7c-663b19ee0d5e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10562024-11-09T02:46:59.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90d3f963-3656-4e5d-9b7c-663b19ee0d5e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10572024-11-09T02:46:59.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90d3f963-3656-4e5d-9b7c-663b19ee0d5e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10582024-11-09T02:46:59.719ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10592024-11-09T02:46:59.719ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10602024-11-09T02:46:59.721ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10612024-11-09T02:46:59.721ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10622024-11-09T02:46:59.722ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10632024-11-09T02:46:59.725ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
10642024-11-09T02:46:59.725ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10652024-11-09T02:47:00.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 71210f21-04f5-4bea-bb19-db6e74088b24 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10662024-11-09T02:47:00.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 71210f21-04f5-4bea-bb19-db6e74088b24 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10672024-11-09T02:47:00.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 71210f21-04f5-4bea-bb19-db6e74088b24 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10682024-11-09T02:47:01.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7ddfbd4-6f5a-4871-b033-8e851e9d361d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10692024-11-09T02:47:01.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7ddfbd4-6f5a-4871-b033-8e851e9d361d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10702024-11-09T02:47:01.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7ddfbd4-6f5a-4871-b033-8e851e9d361d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10712024-11-09T02:47:01.726ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10722024-11-09T02:47:01.726ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10732024-11-09T02:47:01.727ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10742024-11-09T02:47:01.728ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10752024-11-09T02:47:01.729ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762024-11-09T02:47:01.732ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
10772024-11-09T02:47:01.732ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10782024-11-09T02:47:02.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaa71d28-56a6-41ee-8e8d-f9fe09df4164 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10792024-11-09T02:47:02.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaa71d28-56a6-41ee-8e8d-f9fe09df4164 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10802024-11-09T02:47:02.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaa71d28-56a6-41ee-8e8d-f9fe09df4164 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
10812024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
10822024-11-09T02:47:03.166ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10832024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
10842024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10852024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10862024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
10872024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10882024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
10892024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10902024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
10912024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
10922024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10932024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10942024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
10952024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10962024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
10972024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10982024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
10992024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11002024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
11012024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11022024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
11032024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11042024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
11052024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
11062024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11072024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11082024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11092024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11102024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11112024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11122024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11132024-11-09T02:47:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11142024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11152024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11162024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11172024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11182024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11192024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11202024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
11212024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
11222024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
11232024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.22\u{b5}s iteration = 2 status = {"errors":[],"records_set_to_done":[]}
11242024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.82\u{b5}s iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11252024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.28\u{b5}s iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11262024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
11272024-11-09T02:47:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.41\u{b5}s iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
11282024-11-09T02:47:03.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-11-09T02:47:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-11-09T02:47:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11312024-11-09T02:47:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11322024-11-09T02:47:03.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11332024-11-09T02:47:03.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11342024-11-09T02:47:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11352024-11-09T02:47:03.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11362024-11-09T02:47:03.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11372024-11-09T02:47:03.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11382024-11-09T02:47:03.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 926, tv_nsec: 514477421 } })
11392024-11-09T02:47:03.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
11402024-11-09T02:47:03.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-11-09T02:47:03.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422024-11-09T02:47:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11432024-11-09T02:47:03.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11442024-11-09T02:47:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11452024-11-09T02:47:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11462024-11-09T02:47:03.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11472024-11-09T02:47:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11482024-11-09T02:47:03.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11492024-11-09T02:47:03.181ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502024-11-09T02:47:03.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11522024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11532024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11542024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11552024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11562024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11572024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11582024-11-09T02:47:03.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11592024-11-09T02:47:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11602024-11-09T02:47:03.185ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
11612024-11-09T02:47:03.185ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.281559ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11622024-11-09T02:47:03.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 926, tv_nsec: 527493300 } })
11632024-11-09T02:47:03.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
11642024-11-09T02:47:03.193ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
11652024-11-09T02:47:03.193ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 26.853415ms iteration = 4 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
11662024-11-09T02:47:03.195ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 29.014829ms iteration = 2 status = {}
11672024-11-09T02:47:03.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11682024-11-09T02:47:03.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11692024-11-09T02:47:03.207ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 41.117829ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11702024-11-09T02:47:03.223ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11712024-11-09T02:47:03.223ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.864565ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11722024-11-09T02:47:03.223ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11732024-11-09T02:47:03.223ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11742024-11-09T02:47:03.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11752024-11-09T02:47:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11762024-11-09T02:47:03.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11772024-11-09T02:47:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11782024-11-09T02:47:03.225ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11792024-11-09T02:47:03.225ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11802024-11-09T02:47:03.225ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e428028-b09d-4749-ad1a-41f2bd208889", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
11812024-11-09T02:47:03.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11822024-11-09T02:47:03.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11832024-11-09T02:47:03.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.651892ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11842024-11-09T02:47:03.262ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11852024-11-09T02:47:03.262ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11862024-11-09T02:47:03.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11872024-11-09T02:47:03.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11882024-11-09T02:47:03.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11892024-11-09T02:47:03.264ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11902024-11-09T02:47:03.264ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a54b3a4-8a73-4c7b-b3f3-4ba5dd449f32", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
11912024-11-09T02:47:03.264ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11922024-11-09T02:47:03.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.2244ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11932024-11-09T02:47:03.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11942024-11-09T02:47:03.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11952024-11-09T02:47:03.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11962024-11-09T02:47:03.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11972024-11-09T02:47:03.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11982024-11-09T02:47:03.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992024-11-09T02:47:03.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
12002024-11-09T02:47:03.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12012024-11-09T02:47:03.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12022024-11-09T02:47:03.277ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 111.469204ms iteration = 2 status = 0
12032024-11-09T02:47:03.288ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 121.693605ms iteration = 2 status = {}
12042024-11-09T02:47:03.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12052024-11-09T02:47:03.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12062024-11-09T02:47:03.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.708849ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12072024-11-09T02:47:03.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12082024-11-09T02:47:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12092024-11-09T02:47:03.332ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12102024-11-09T02:47:03.332ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4662ec3-1d09-41f8-9170-198bf7b28df3", "content-length": "1", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
12112024-11-09T02:47:03.333ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12122024-11-09T02:47:03.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12132024-11-09T02:47:03.335ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12142024-11-09T02:47:03.335ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12152024-11-09T02:47:03.335ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "930f2b2a-2fc0-452b-a520-8236bd4bd29d", "content-length": "372", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
12162024-11-09T02:47:03.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12172024-11-09T02:47:03.335ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 169.459572ms iteration = 2 status = null
12182024-11-09T02:47:03.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12192024-11-09T02:47:03.376ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12202024-11-09T02:47:03.376ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12212024-11-09T02:47:03.376ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "889d3e8e-8a52-41e4-91e0-76f307c84f31", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
12222024-11-09T02:47:03.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12232024-11-09T02:47:03.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12242024-11-09T02:47:03.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12252024-11-09T02:47:03.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12262024-11-09T02:47:03.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12272024-11-09T02:47:03.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12282024-11-09T02:47:03.386ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12292024-11-09T02:47:03.386ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12302024-11-09T02:47:03.386ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e1cd3f2b-04ce-47ac-80b2-a9497a1df40e", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
12312024-11-09T02:47:03.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12322024-11-09T02:47:03.388ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 222.016068ms iteration = 2 status = {}
12332024-11-09T02:47:03.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12342024-11-09T02:47:03.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12352024-11-09T02:47:03.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12362024-11-09T02:47:03.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12372024-11-09T02:47:03.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12382024-11-09T02:47:03.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392024-11-09T02:47:03.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12402024-11-09T02:47:03.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12412024-11-09T02:47:03.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12422024-11-09T02:47:03.485ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12432024-11-09T02:47:03.485ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d04a1d92-95d0-4ca9-9ee0-91617990b815", "content-length": "691", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
12442024-11-09T02:47:03.486ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12452024-11-09T02:47:03.486ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12462024-11-09T02:47:03.486ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12472024-11-09T02:47:03.487ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.421352ms iteration = 2 status = {}
12482024-11-09T02:47:03.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 605c65c4-a2ff-4c84-9e79-198579eef373 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12492024-11-09T02:47:03.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 605c65c4-a2ff-4c84-9e79-198579eef373 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12502024-11-09T02:47:03.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 605c65c4-a2ff-4c84-9e79-198579eef373 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12512024-11-09T02:47:03.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 4c5bdb03-6eb8-47d0-9fa0-2a64e63353e1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12522024-11-09T02:47:03.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 4c5bdb03-6eb8-47d0-9fa0-2a64e63353e1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12532024-11-09T02:47:03.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 4c5bdb03-6eb8-47d0-9fa0-2a64e63353e1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12542024-11-09T02:47:03.732ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12552024-11-09T02:47:03.732ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12562024-11-09T02:47:03.734ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12572024-11-09T02:47:03.734ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12582024-11-09T02:47:03.736ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-11-09T02:47:03.738ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
12602024-11-09T02:47:03.738ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12612024-11-09T02:47:03.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 820e85e3-6f18-4fd1-a130-7da50e0206cf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12622024-11-09T02:47:03.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 820e85e3-6f18-4fd1-a130-7da50e0206cf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12632024-11-09T02:47:03.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 820e85e3-6f18-4fd1-a130-7da50e0206cf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12642024-11-09T02:47:04.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 512492b2-afef-4b38-880e-47df341f56cf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12652024-11-09T02:47:04.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 512492b2-afef-4b38-880e-47df341f56cf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12662024-11-09T02:47:04.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 512492b2-afef-4b38-880e-47df341f56cf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12672024-11-09T02:47:05.739ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12682024-11-09T02:47:05.740ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12692024-11-09T02:47:05.742ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12702024-11-09T02:47:05.742ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12712024-11-09T02:47:05.743ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12722024-11-09T02:47:05.746ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
12732024-11-09T02:47:05.746ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12742024-11-09T02:47:05.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a421ca50-f768-45b2-bccd-f0bcca16ef30 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12752024-11-09T02:47:05.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a421ca50-f768-45b2-bccd-f0bcca16ef30 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12762024-11-09T02:47:05.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a421ca50-f768-45b2-bccd-f0bcca16ef30 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12772024-11-09T02:47:06.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 232d825f-859c-4db3-a556-7aade6e2b201 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12782024-11-09T02:47:06.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 232d825f-859c-4db3-a556-7aade6e2b201 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12792024-11-09T02:47:06.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 232d825f-859c-4db3-a556-7aade6e2b201 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12802024-11-09T02:47:07.747ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12812024-11-09T02:47:07.747ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12822024-11-09T02:47:07.748ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12832024-11-09T02:47:07.749ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12842024-11-09T02:47:07.750ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852024-11-09T02:47:07.753ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
12862024-11-09T02:47:07.753ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12872024-11-09T02:47:07.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f8529b14-28e2-4a3e-afaf-f161d5aebf54 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12882024-11-09T02:47:07.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f8529b14-28e2-4a3e-afaf-f161d5aebf54 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12892024-11-09T02:47:07.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f8529b14-28e2-4a3e-afaf-f161d5aebf54 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12902024-11-09T02:47:08.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06316637-bf96-4f36-8420-aa371a47bc19 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12912024-11-09T02:47:08.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06316637-bf96-4f36-8420-aa371a47bc19 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12922024-11-09T02:47:08.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06316637-bf96-4f36-8420-aa371a47bc19 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
12932024-11-09T02:47:09.755ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12942024-11-09T02:47:09.755ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12952024-11-09T02:47:09.757ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12962024-11-09T02:47:09.757ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12972024-11-09T02:47:09.759ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982024-11-09T02:47:09.762ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
12992024-11-09T02:47:09.762ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
13002024-11-09T02:47:09.762ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13012024-11-09T02:47:09.762ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13022024-11-09T02:47:09.764ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13032024-11-09T02:47:09.764ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13042024-11-09T02:47:09.766ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13052024-11-09T02:47:09.766ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13062024-11-09T02:47:09.768ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13072024-11-09T02:47:09.768ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13082024-11-09T02:47:09.770ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13092024-11-09T02:47:09.770ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13102024-11-09T02:47:09.771ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13112024-11-09T02:47:09.771ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13122024-11-09T02:47:09.773ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132024-11-09T02:47:09.776ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13142024-11-09T02:47:09.776ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13152024-11-09T02:47:09.776ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13162024-11-09T02:47:09.777ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13172024-11-09T02:47:09.778ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13182024-11-09T02:47:09.779ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13192024-11-09T02:47:09.779ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13202024-11-09T02:47:09.780ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13212024-11-09T02:47:09.783ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13222024-11-09T02:47:09.783ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13232024-11-09T02:47:09.784ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13242024-11-09T02:47:09.787ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13252024-11-09T02:47:09.787ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13262024-11-09T02:47:09.788ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13272024-11-09T02:47:09.788ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13282024-11-09T02:47:09.789ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13292024-11-09T02:47:09.790ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13302024-11-09T02:47:09.791ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13312024-11-09T02:47:09.791ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13322024-11-09T02:47:09.792ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13332024-11-09T02:47:09.792ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13342024-11-09T02:47:09.794ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13352024-11-09T02:47:09.794ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13362024-11-09T02:47:09.795ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13372024-11-09T02:47:09.798ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13382024-11-09T02:47:09.798ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13392024-11-09T02:47:09.798ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13402024-11-09T02:47:09.799ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13412024-11-09T02:47:09.799ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13422024-11-09T02:47:09.800ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13432024-11-09T02:47:09.801ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13442024-11-09T02:47:09.803ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13452024-11-09T02:47:09.803ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13462024-11-09T02:47:09.805ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13472024-11-09T02:47:09.805ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13482024-11-09T02:47:09.806ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13492024-11-09T02:47:09.806ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13502024-11-09T02:47:09.807ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13512024-11-09T02:47:09.807ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13522024-11-09T02:47:09.809ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13532024-11-09T02:47:09.812ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13542024-11-09T02:47:09.812ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13552024-11-09T02:47:09.812ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13562024-11-09T02:47:09.813ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13572024-11-09T02:47:09.813ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13582024-11-09T02:47:09.815ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13592024-11-09T02:47:09.815ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13602024-11-09T02:47:09.816ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13612024-11-09T02:47:09.819ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13622024-11-09T02:47:09.819ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13632024-11-09T02:47:09.820ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13642024-11-09T02:47:09.826ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13652024-11-09T02:47:09.827ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13662024-11-09T02:47:09.828ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13672024-11-09T02:47:09.828ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13682024-11-09T02:47:09.829ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13692024-11-09T02:47:09.829ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13702024-11-09T02:47:09.831ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13712024-11-09T02:47:09.831ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13722024-11-09T02:47:09.832ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13732024-11-09T02:47:09.833ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13742024-11-09T02:47:09.833ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13752024-11-09T02:47:09.834ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13762024-11-09T02:47:09.835ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13772024-11-09T02:47:09.835ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13782024-11-09T02:47:09.836ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13792024-11-09T02:47:09.839ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
13802024-11-09T02:47:09.839ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13812024-11-09T02:47:09.840ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13822024-11-09T02:47:09.841ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13832024-11-09T02:47:09.841ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13842024-11-09T02:47:09.842ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13852024-11-09T02:47:09.842ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13862024-11-09T02:47:09.843ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-11-09T02:47:09.846ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
13882024-11-09T02:47:09.846ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13892024-11-09T02:47:09.846ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13902024-11-09T02:47:09.852ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
13912024-11-09T02:47:09.852ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13922024-11-09T02:47:09.852ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13932024-11-09T02:47:09.854ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13942024-11-09T02:47:09.856ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
13952024-11-09T02:47:09.856ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13962024-11-09T02:47:09.856ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13972024-11-09T02:47:09.857ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
13982024-11-09T02:47:09.860ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
13992024-11-09T02:47:09.860ZDEBGnexus (InternalApi): resolved 2 rules for sleds
14002024-11-09T02:47:09.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 815b191b-4b30-4c33-a202-b5090a02f3dd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14012024-11-09T02:47:09.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 815b191b-4b30-4c33-a202-b5090a02f3dd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14022024-11-09T02:47:09.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 815b191b-4b30-4c33-a202-b5090a02f3dd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14032024-11-09T02:47:09.911ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
14042024-11-09T02:47:09.911ZDEBGnexus (InternalApi): sending firewall rules to sled agents
14052024-11-09T02:47:09.911ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14062024-11-09T02:47:09.911ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14072024-11-09T02:47:09.912ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14082024-11-09T02:47:09.913ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14092024-11-09T02:47:09.914ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102024-11-09T02:47:09.916ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
14112024-11-09T02:47:09.947ZDEBGnexus (InternalApi): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14122024-11-09T02:47:09.947ZDEBGnexus (InternalApi): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "e275dfd2-6c35-433e-a6a9-2dc1056535a7", "date": "Sat, 09 Nov 2024 02:47:09 GMT"} })
14132024-11-09T02:47:09.948ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
14142024-11-09T02:47:09.948ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
14152024-11-09T02:47:10.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f5117be0-77b4-4f01-86a3-7f130f442411 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14162024-11-09T02:47:10.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f5117be0-77b4-4f01-86a3-7f130f442411 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14172024-11-09T02:47:10.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f5117be0-77b4-4f01-86a3-7f130f442411 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14182024-11-09T02:47:11.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = face4448-ceac-414a-81c3-f20dadb74967 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14192024-11-09T02:47:11.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = face4448-ceac-414a-81c3-f20dadb74967 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14202024-11-09T02:47:11.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = face4448-ceac-414a-81c3-f20dadb74967 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14212024-11-09T02:47:12.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0e6fd3bc-9644-4054-88eb-4fcb737f72be roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14222024-11-09T02:47:12.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0e6fd3bc-9644-4054-88eb-4fcb737f72be resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14232024-11-09T02:47:12.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0e6fd3bc-9644-4054-88eb-4fcb737f72be response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14242024-11-09T02:47:13.165ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
14252024-11-09T02:47:13.165ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
14262024-11-09T02:47:13.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14272024-11-09T02:47:13.165ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14282024-11-09T02:47:13.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14292024-11-09T02:47:13.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14302024-11-09T02:47:13.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14312024-11-09T02:47:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14322024-11-09T02:47:13.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14332024-11-09T02:47:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14342024-11-09T02:47:13.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14352024-11-09T02:47:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14362024-11-09T02:47:13.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-11-09T02:47:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
14382024-11-09T02:47:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14392024-11-09T02:47:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14402024-11-09T02:47:13.191ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
14412024-11-09T02:47:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.304984ms iteration = 5 status = {"enabled":false,"status":"first target blueprint","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z","time_found":"2024-11-09T02:47:13.191848276Z"}
14422024-11-09T02:47:13.191ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
14432024-11-09T02:47:13.191ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
14442024-11-09T02:47:13.191ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
14452024-11-09T02:47:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.65\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
14462024-11-09T02:47:13.191ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14472024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14482024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14492024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14502024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14512024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14522024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14532024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14542024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14552024-11-09T02:47:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14562024-11-09T02:47:13.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572024-11-09T02:47:13.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14582024-11-09T02:47:13.197ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14592024-11-09T02:47:13.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14602024-11-09T02:47:13.197ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612024-11-09T02:47:13.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14622024-11-09T02:47:13.198ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14632024-11-09T02:47:13.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14642024-11-09T02:47:13.199ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652024-11-09T02:47:13.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14662024-11-09T02:47:13.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14672024-11-09T02:47:13.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14682024-11-09T02:47:13.200ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14692024-11-09T02:47:13.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14702024-11-09T02:47:13.200ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14712024-11-09T02:47:13.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.114737ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14722024-11-09T02:47:13.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14732024-11-09T02:47:13.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14742024-11-09T02:47:13.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14752024-11-09T02:47:13.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-11-09T02:47:13.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14772024-11-09T02:47:13.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14782024-11-09T02:47:13.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14792024-11-09T02:47:13.237ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
14802024-11-09T02:47:13.271ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
14812024-11-09T02:47:13.306ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
14822024-11-09T02:47:13.342ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
14832024-11-09T02:47:13.376ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
14842024-11-09T02:47:13.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2dabb8d2-8394-4b78-9f5f-bcb7cfe3340d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14852024-11-09T02:47:13.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2dabb8d2-8394-4b78-9f5f-bcb7cfe3340d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14862024-11-09T02:47:13.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2dabb8d2-8394-4b78-9f5f-bcb7cfe3340d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
14872024-11-09T02:47:14.200ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a179286-3ffe-4f28-b36c-7188cdb634dd", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:14 GMT"} })
14882024-11-09T02:47:14.200ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14892024-11-09T02:47:14.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14902024-11-09T02:47:14.201ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b568cb-a325-4780-a9e1-6826fdff6ec6", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
14912024-11-09T02:47:14.201ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14922024-11-09T02:47:14.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14932024-11-09T02:47:14.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14942024-11-09T02:47:14.203ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14952024-11-09T02:47:14.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14962024-11-09T02:47:14.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14972024-11-09T02:47:14.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14982024-11-09T02:47:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14992024-11-09T02:47:14.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15002024-11-09T02:47:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15012024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66df48ec-c6dc-4940-b1ba-1eea626ee32b", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:14 GMT"} })
15022024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15032024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15042024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f2cf1ec-6cdb-416f-8eaf-3d8e20ede49f", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:14 GMT"} })
15052024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15062024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15072024-11-09T02:47:14.219ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15082024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15092024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15102024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15112024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122024-11-09T02:47:14.221ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15132024-11-09T02:47:14.221ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15142024-11-09T02:47:14.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15152024-11-09T02:47:14.231ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec913867-a495-48f1-b110-e320d89ac6ce", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
15162024-11-09T02:47:14.231ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15172024-11-09T02:47:14.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15182024-11-09T02:47:14.232ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15192024-11-09T02:47:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15202024-11-09T02:47:14.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15212024-11-09T02:47:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15222024-11-09T02:47:14.239ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.04809606s iteration = 2 status = {"nsuccess":5}
15232024-11-09T02:47:15.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a84e654-8692-489b-a1ea-75e5fd65b594 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15242024-11-09T02:47:15.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a84e654-8692-489b-a1ea-75e5fd65b594 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15252024-11-09T02:47:15.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a84e654-8692-489b-a1ea-75e5fd65b594 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15262024-11-09T02:47:16.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5dc467c0-3b45-4a48-89b4-711276f88580 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15272024-11-09T02:47:16.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5dc467c0-3b45-4a48-89b4-711276f88580 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15282024-11-09T02:47:16.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5dc467c0-3b45-4a48-89b4-711276f88580 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15292024-11-09T02:47:17.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a594c6f3-f0e4-4a22-8f02-eb8165f7681c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15302024-11-09T02:47:17.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a594c6f3-f0e4-4a22-8f02-eb8165f7681c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15312024-11-09T02:47:17.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a594c6f3-f0e4-4a22-8f02-eb8165f7681c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15322024-11-09T02:47:18.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca917148-5cac-4af6-b1c1-6cda753f3cf7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15332024-11-09T02:47:18.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca917148-5cac-4af6-b1c1-6cda753f3cf7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15342024-11-09T02:47:18.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca917148-5cac-4af6-b1c1-6cda753f3cf7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15352024-11-09T02:47:19.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e21611a0-3a6a-4ebb-8236-736f2228937e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15362024-11-09T02:47:19.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e21611a0-3a6a-4ebb-8236-736f2228937e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15372024-11-09T02:47:19.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e21611a0-3a6a-4ebb-8236-736f2228937e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15382024-11-09T02:47:20.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7baa2ccc-62e4-4116-9dfd-c7032a8fc6dc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15392024-11-09T02:47:20.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7baa2ccc-62e4-4116-9dfd-c7032a8fc6dc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15402024-11-09T02:47:20.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7baa2ccc-62e4-4116-9dfd-c7032a8fc6dc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15412024-11-09T02:47:21.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e41ca878-f5b5-440a-bb17-2ce63bd79840 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15422024-11-09T02:47:21.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e41ca878-f5b5-440a-bb17-2ce63bd79840 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15432024-11-09T02:47:21.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e41ca878-f5b5-440a-bb17-2ce63bd79840 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15442024-11-09T02:47:22.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d664786-60e4-4a4e-bbc8-24f4f37976ea roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15452024-11-09T02:47:22.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d664786-60e4-4a4e-bbc8-24f4f37976ea resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15462024-11-09T02:47:22.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d664786-60e4-4a4e-bbc8-24f4f37976ea response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15472024-11-09T02:47:23.165ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
15482024-11-09T02:47:23.165ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
15492024-11-09T02:47:23.165ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15502024-11-09T02:47:23.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15512024-11-09T02:47:23.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15522024-11-09T02:47:23.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15532024-11-09T02:47:23.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542024-11-09T02:47:23.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15552024-11-09T02:47:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15562024-11-09T02:47:23.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.325719ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15572024-11-09T02:47:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15582024-11-09T02:47:23.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15592024-11-09T02:47:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15602024-11-09T02:47:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15612024-11-09T02:47:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15622024-11-09T02:47:23.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15632024-11-09T02:47:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
15642024-11-09T02:47:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15652024-11-09T02:47:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15662024-11-09T02:47:23.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9030dc19-a7f1-41a7-a17b-766bff67a257 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15672024-11-09T02:47:23.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9030dc19-a7f1-41a7-a17b-766bff67a257 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15682024-11-09T02:47:23.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9030dc19-a7f1-41a7-a17b-766bff67a257 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15692024-11-09T02:47:23.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
15702024-11-09T02:47:23.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.330636ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
15712024-11-09T02:47:24.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8871b314-0cc7-4cc4-9278-9efc398e37bd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15722024-11-09T02:47:24.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8871b314-0cc7-4cc4-9278-9efc398e37bd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15732024-11-09T02:47:24.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8871b314-0cc7-4cc4-9278-9efc398e37bd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15742024-11-09T02:47:25.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5eef75c-4e85-4aa7-92a3-bf20469e3c99 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15752024-11-09T02:47:25.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5eef75c-4e85-4aa7-92a3-bf20469e3c99 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15762024-11-09T02:47:25.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5eef75c-4e85-4aa7-92a3-bf20469e3c99 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15772024-11-09T02:47:26.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1ece6a3-f1e0-41f8-a507-1820178759ee roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15782024-11-09T02:47:26.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1ece6a3-f1e0-41f8-a507-1820178759ee resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15792024-11-09T02:47:26.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1ece6a3-f1e0-41f8-a507-1820178759ee response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15802024-11-09T02:47:27.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d4ee66b-3645-4bef-b7ba-4fbb993b74ce roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15812024-11-09T02:47:27.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d4ee66b-3645-4bef-b7ba-4fbb993b74ce resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15822024-11-09T02:47:27.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d4ee66b-3645-4bef-b7ba-4fbb993b74ce response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15832024-11-09T02:47:28.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a5b7299-4230-423d-baea-2b584f4ea475 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15842024-11-09T02:47:28.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a5b7299-4230-423d-baea-2b584f4ea475 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15852024-11-09T02:47:28.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a5b7299-4230-423d-baea-2b584f4ea475 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15862024-11-09T02:47:29.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07bdb31c-0ec2-45aa-b376-c228d938f3eb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15872024-11-09T02:47:29.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07bdb31c-0ec2-45aa-b376-c228d938f3eb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15882024-11-09T02:47:29.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07bdb31c-0ec2-45aa-b376-c228d938f3eb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15892024-11-09T02:47:30.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8f6da76f-8d90-4930-b714-08457d9a3174 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15902024-11-09T02:47:30.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8f6da76f-8d90-4930-b714-08457d9a3174 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15912024-11-09T02:47:30.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8f6da76f-8d90-4930-b714-08457d9a3174 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15922024-11-09T02:47:31.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3b98f2d4-f396-4a22-b4c2-1984f18aec9f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15932024-11-09T02:47:31.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3b98f2d4-f396-4a22-b4c2-1984f18aec9f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15942024-11-09T02:47:31.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3b98f2d4-f396-4a22-b4c2-1984f18aec9f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15952024-11-09T02:47:32.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 548f2e90-acdf-44e8-99a2-99ebdff7b3d0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15962024-11-09T02:47:32.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 548f2e90-acdf-44e8-99a2-99ebdff7b3d0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15972024-11-09T02:47:32.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 548f2e90-acdf-44e8-99a2-99ebdff7b3d0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
15982024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
15992024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16002024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16012024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
16022024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16032024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16042024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
16052024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16062024-11-09T02:47:33.165ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16072024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16082024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16092024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16102024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16112024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16122024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
16132024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16142024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
16152024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16162024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16172024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16182024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16192024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
16202024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16212024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16222024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
16232024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16242024-11-09T02:47:33.165ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16252024-11-09T02:47:33.166ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
16262024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
16272024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.111\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
16282024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16292024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
16302024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16312024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16322024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16332024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16342024-11-09T02:47:33.166ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:37:33.165922969 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16352024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16362024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
16372024-11-09T02:47:33.166ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16382024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
16392024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16402024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16412024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16422024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16432024-11-09T02:47:33.166ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16442024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 11.34\u{b5}s iteration = 3 status = {"error":"no config"}
16452024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16462024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16472024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16482024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
16492024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16502024-11-09T02:47:33.166ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16512024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 10.01\u{b5}s iteration = 3 status = {"error":"no config"}
16522024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16532024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16542024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16552024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16562024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16572024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16582024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16592024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16602024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16612024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16622024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16632024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16642024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16652024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16662024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16672024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
16682024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16692024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
16702024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
16712024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.141\u{b5}s iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16722024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
16732024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.04\u{b5}s iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
16742024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.84\u{b5}s iteration = 3 status = {"errors":[],"records_set_to_done":[]}
16752024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
16762024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
16772024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16782024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
16792024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16802024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 26.68\u{b5}s iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16812024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16822024-11-09T02:47:33.166ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 507529497 } })
16832024-11-09T02:47:33.166ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 507544137 } })
16842024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
16852024-11-09T02:47:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
16862024-11-09T02:47:33.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16872024-11-09T02:47:33.167ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
16882024-11-09T02:47:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.616473ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
16892024-11-09T02:47:33.167ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
16902024-11-09T02:47:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.753456ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
16912024-11-09T02:47:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16922024-11-09T02:47:33.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16932024-11-09T02:47:33.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942024-11-09T02:47:33.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952024-11-09T02:47:33.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16962024-11-09T02:47:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16972024-11-09T02:47:33.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16982024-11-09T02:47:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.666778ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16992024-11-09T02:47:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17002024-11-09T02:47:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17012024-11-09T02:47:33.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17022024-11-09T02:47:33.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17032024-11-09T02:47:33.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17042024-11-09T02:47:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17052024-11-09T02:47:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17062024-11-09T02:47:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17072024-11-09T02:47:33.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17082024-11-09T02:47:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17092024-11-09T02:47:33.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 517815730 } })
17102024-11-09T02:47:33.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
17112024-11-09T02:47:33.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17122024-11-09T02:47:33.178ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17132024-11-09T02:47:33.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142024-11-09T02:47:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17152024-11-09T02:47:33.179ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17162024-11-09T02:47:33.179ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17172024-11-09T02:47:33.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17182024-11-09T02:47:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17192024-11-09T02:47:33.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17202024-11-09T02:47:33.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17212024-11-09T02:47:33.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17222024-11-09T02:47:33.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17232024-11-09T02:47:33.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17242024-11-09T02:47:33.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17252024-11-09T02:47:33.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17262024-11-09T02:47:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17272024-11-09T02:47:33.189ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 530249157 } })
17282024-11-09T02:47:33.189ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
17292024-11-09T02:47:33.194ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:37:33.165922969 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17302024-11-09T02:47:33.194ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.237794ms iteration = 2 status = {"expiration":"2024-11-09T02:37:33.165922969Z","pruned":[]}
17312024-11-09T02:47:33.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17322024-11-09T02:47:33.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17332024-11-09T02:47:33.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342024-11-09T02:47:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17352024-11-09T02:47:33.197ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 538606809 } })
17362024-11-09T02:47:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17372024-11-09T02:47:33.198ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
17382024-11-09T02:47:33.200ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 33.38696ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17392024-11-09T02:47:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17402024-11-09T02:47:33.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17412024-11-09T02:47:33.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.488904ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17422024-11-09T02:47:33.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17432024-11-09T02:47:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17442024-11-09T02:47:33.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17452024-11-09T02:47:33.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17462024-11-09T02:47:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17472024-11-09T02:47:33.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17482024-11-09T02:47:33.205ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17492024-11-09T02:47:33.205ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17502024-11-09T02:47:33.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17512024-11-09T02:47:33.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17522024-11-09T02:47:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17532024-11-09T02:47:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17542024-11-09T02:47:33.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17552024-11-09T02:47:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17562024-11-09T02:47:33.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
17572024-11-09T02:47:33.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17582024-11-09T02:47:33.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17592024-11-09T02:47:33.212ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17602024-11-09T02:47:33.212ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17612024-11-09T02:47:33.212ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17622024-11-09T02:47:33.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17632024-11-09T02:47:33.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17642024-11-09T02:47:33.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-11-09T02:47:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17662024-11-09T02:47:33.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17672024-11-09T02:47:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17682024-11-09T02:47:33.229ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
17692024-11-09T02:47:33.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.266358ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
17702024-11-09T02:47:33.231ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17712024-11-09T02:47:33.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17722024-11-09T02:47:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17732024-11-09T02:47:33.234ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17742024-11-09T02:47:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17752024-11-09T02:47:33.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17762024-11-09T02:47:33.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17772024-11-09T02:47:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17782024-11-09T02:47:33.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17792024-11-09T02:47:33.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17802024-11-09T02:47:33.249ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17812024-11-09T02:47:33.249ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
17822024-11-09T02:47:33.249ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
17832024-11-09T02:47:33.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17842024-11-09T02:47:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17852024-11-09T02:47:33.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17862024-11-09T02:47:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17872024-11-09T02:47:33.256ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17882024-11-09T02:47:33.256ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17892024-11-09T02:47:33.256ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.182204ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17902024-11-09T02:47:33.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17912024-11-09T02:47:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17922024-11-09T02:47:33.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17932024-11-09T02:47:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17942024-11-09T02:47:33.266ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17952024-11-09T02:47:33.266ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17962024-11-09T02:47:33.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.562188ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17972024-11-09T02:47:33.268ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17982024-11-09T02:47:33.268ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.408246ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17992024-11-09T02:47:33.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18002024-11-09T02:47:33.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18012024-11-09T02:47:33.341ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18022024-11-09T02:47:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18032024-11-09T02:47:33.345ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18042024-11-09T02:47:33.345ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18052024-11-09T02:47:33.346ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "13eaa351-1ff4-4f4a-a245-0be91c850690", "content-length": "372", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
18062024-11-09T02:47:33.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18072024-11-09T02:47:33.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18082024-11-09T02:47:33.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18092024-11-09T02:47:33.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18102024-11-09T02:47:33.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18112024-11-09T02:47:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18122024-11-09T02:47:33.394ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18132024-11-09T02:47:33.394ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18142024-11-09T02:47:33.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18152024-11-09T02:47:33.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18162024-11-09T02:47:33.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172024-11-09T02:47:33.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18182024-11-09T02:47:33.399ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18192024-11-09T02:47:33.399ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18202024-11-09T02:47:33.399ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 233.223319ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18212024-11-09T02:47:33.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222024-11-09T02:47:33.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 234.19584ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18232024-11-09T02:47:33.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242024-11-09T02:47:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18252024-11-09T02:47:33.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18262024-11-09T02:47:33.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 88b1ede9-c064-4067-896e-8b815f79b953 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
18272024-11-09T02:47:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18282024-11-09T02:47:33.402ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18292024-11-09T02:47:33.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18302024-11-09T02:47:33.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18312024-11-09T02:47:33.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 88b1ede9-c064-4067-896e-8b815f79b953 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
18322024-11-09T02:47:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18332024-11-09T02:47:33.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18342024-11-09T02:47:33.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18352024-11-09T02:47:33.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18362024-11-09T02:47:33.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
18372024-11-09T02:47:33.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18382024-11-09T02:47:33.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18392024-11-09T02:47:33.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 88b1ede9-c064-4067-896e-8b815f79b953 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
18402024-11-09T02:47:33.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18412024-11-09T02:47:33.406ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18422024-11-09T02:47:33.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18432024-11-09T02:47:33.407ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
18442024-11-09T02:47:33.407ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
18452024-11-09T02:47:33.407ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
18462024-11-09T02:47:33.407ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 241.021511ms iteration = 2 status = {"generation":1}
18472024-11-09T02:47:33.407ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
18482024-11-09T02:47:33.407ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 241.774046ms iteration = 3 status = 0
18492024-11-09T02:47:33.417ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
18502024-11-09T02:47:33.417ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18512024-11-09T02:47:33.417ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf364d3d-cb23-4b27-892c-9ed2aee1a3d7", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
18522024-11-09T02:47:33.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18532024-11-09T02:47:33.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18542024-11-09T02:47:33.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18552024-11-09T02:47:33.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18562024-11-09T02:47:33.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18572024-11-09T02:47:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18582024-11-09T02:47:33.428ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18592024-11-09T02:47:33.429ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18602024-11-09T02:47:33.429ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "25425ec9-d476-4fa3-8192-501d75ff8fac", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
18612024-11-09T02:47:33.430ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 264.969556ms iteration = 3 status = {}
18622024-11-09T02:47:33.431ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
18632024-11-09T02:47:33.431ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 265.605568ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18642024-11-09T02:47:33.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
18652024-11-09T02:47:33.435ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18662024-11-09T02:47:33.436ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f228259-46f5-4759-8bd7-505bc11351ca", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
18672024-11-09T02:47:33.436ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18682024-11-09T02:47:33.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18692024-11-09T02:47:33.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-11-09T02:47:33.442ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18712024-11-09T02:47:33.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18722024-11-09T02:47:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18732024-11-09T02:47:33.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18742024-11-09T02:47:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18752024-11-09T02:47:33.443ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18762024-11-09T02:47:33.443ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
18772024-11-09T02:47:33.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18782024-11-09T02:47:33.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18792024-11-09T02:47:33.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-11-09T02:47:33.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18812024-11-09T02:47:33.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18822024-11-09T02:47:33.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18832024-11-09T02:47:33.462ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 296.226141ms iteration = 5 status = {"physical_disks_added":0}
18842024-11-09T02:47:33.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852024-11-09T02:47:33.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18862024-11-09T02:47:33.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18872024-11-09T02:47:33.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18882024-11-09T02:47:33.476ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
18892024-11-09T02:47:33.476ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18902024-11-09T02:47:33.476ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
18912024-11-09T02:47:33.476ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 310.66405ms iteration = 2 status = {"generation":2}
18922024-11-09T02:47:33.476ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
18932024-11-09T02:47:33.489ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
18942024-11-09T02:47:33.489ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 323.2638ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18952024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /
18962024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access
18972024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path}
18982024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth
18992024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm
19002024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success
19012024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token
19022024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify
19032024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes
19042024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes
19052024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe}
19062024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe}
19072024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images
19082024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login
19092024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local
19102024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}
19112024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name}
19122024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
19132024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path}
19142024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path}
19152024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new
19162024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path}
19172024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path}
19182024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization
19192024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates
19202024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates
19212024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate}
19222024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate}
19232024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks
19242024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks
19252024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk}
19262024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}
19272024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write
19282024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start
19292024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
19302024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize
19312024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
19322024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips
19332024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips
19342024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip}
19352024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip}
19362024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip}
19372024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
19382024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
19392024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups
19402024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id}
19412024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images
19422024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images
19432024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image}
19442024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image}
19452024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote
19462024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote
19472024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances
19482024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances
19492024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}
19502024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}
19512024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance}
19522024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks
19532024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach
19542024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach
19552024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips
19562024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
19572024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
19582024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot
19592024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console
19602024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream
19612024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
19622024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start
19632024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop
19642024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses
19652024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses
19662024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address}
19672024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools
19682024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools
19692024-11-09T02:47:33.502ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool}
19702024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways
19712024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways
19722024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway}
19732024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway}
19742024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools
19752024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool}
19762024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local
19772024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout
19782024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me
19792024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups
19802024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys
19812024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys
19822024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
19832024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
19842024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name}
19852024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces
19862024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces
19872024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface}
19882024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface}
19892024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface}
19902024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping
19912024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy
19922024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy
19932024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects
19942024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects
19952024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project}
19962024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}
19972024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}
19982024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy
19992024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy
20002024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots
20012024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots
20022024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot}
20032024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot}
20042024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks
20052024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id}
20062024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks
20072024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id}
20082024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds
20092024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds
20102024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
20112024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
20122024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
20132024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
20142024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized
20152024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port
20162024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
20172024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
20182024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
20192024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches
20202024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id}
20212024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers
20222024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users
20232024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
20242024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
20252024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml
20262024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider}
20272024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools
20282024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools
20292024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}
20302024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}
20312024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}
20322024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
20332024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
20342024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
20352024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos
20362024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos
20372024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
20382024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
20392024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
20402024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service
20412024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges
20422024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add
20432024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
20442024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name}
20452024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot
20462024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot
20472024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
20482024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
20492024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list
20502024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list
20512024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable
20522024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable
20532024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status
20542024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp
20552024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp
20562024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp
20572024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set
20582024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set
20592024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
20602024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
20612024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported
20622024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history
20632024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
20642024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status
20652024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address
20662024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address
20672024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
20682024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings
20692024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings
20702024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings
20712024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
20722024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy
20732024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy
20742024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles
20752024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name}
20762024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas
20772024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos
20782024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos
20792024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo}
20802024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}
20812024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools
20822024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy
20832024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy
20842024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas
20852024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas
20862024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository
20872024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version}
20882024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users
20892024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id}
20902024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin
20912024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user}
20922024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos
20932024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo}
20942024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query
20952024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/timeseries/schema
20962024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users
20972024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization
20982024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules
20992024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules
21002024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes
21012024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes
21022024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route}
21032024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route}
21042024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route}
21052024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers
21062024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers
21072024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router}
21082024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router}
21092024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router}
21102024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets
21112024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets
21122024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet}
21132024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}
21142024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet}
21152024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
21162024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs
21172024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs
21182024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc}
21192024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc}
21202024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc}
21212024-11-09T02:47:33.503ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = 172.30.2.6:443
21222024-11-09T02:47:33.503ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
21232024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /
21242024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access
21252024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path}
21262024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth
21272024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm
21282024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success
21292024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token
21302024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify
21312024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes
21322024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes
21332024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe}
21342024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe}
21352024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images
21362024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login
21372024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local
21382024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
21392024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
21402024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
21412024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path}
21422024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path}
21432024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new
21442024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path}
21452024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path}
21462024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization
21472024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates
21482024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates
21492024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate}
21502024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate}
21512024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks
21522024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks
21532024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk}
21542024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}
21552024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write
21562024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
21572024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
21582024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize
21592024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
21602024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips
21612024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips
21622024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
21632024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip}
21642024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
21652024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
21662024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
21672024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups
21682024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id}
21692024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images
21702024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images
21712024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image}
21722024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image}
21732024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote
21742024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote
21752024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances
21762024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances
21772024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}
21782024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}
21792024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance}
21802024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks
21812024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach
21822024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach
21832024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips
21842024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
21852024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
21862024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot
21872024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console
21882024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
21892024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
21902024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start
21912024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop
21922024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses
21932024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses
21942024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address}
21952024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools
21962024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools
21972024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool}
21982024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways
21992024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways
22002024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway}
22012024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway}
22022024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools
22032024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool}
22042024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local
22052024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout
22062024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me
22072024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups
22082024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys
22092024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys
22102024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
22112024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
22122024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name}
22132024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces
22142024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces
22152024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface}
22162024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface}
22172024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface}
22182024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping
22192024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy
22202024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy
22212024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects
22222024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects
22232024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project}
22242024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}
22252024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}
22262024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy
22272024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy
22282024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots
22292024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots
22302024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot}
22312024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot}
22322024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks
22332024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
22342024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks
22352024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
22362024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds
22372024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds
22382024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
22392024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
22402024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
22412024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
22422024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
22432024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port
22442024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
22452024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
22462024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
22472024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches
22482024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
22492024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers
22502024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users
22512024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
22522024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
22532024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml
22542024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
22552024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools
22562024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools
22572024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
22582024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}
22592024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}
22602024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
22612024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
22622024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
22632024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
22642024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
22652024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
22662024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
22672024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
22682024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service
22692024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges
22702024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
22712024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
22722024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name}
22732024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot
22742024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot
22752024-11-09T02:47:33.509ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
22762024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
22772024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list
22782024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list
22792024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable
22802024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable
22812024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status
22822024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp
22832024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp
22842024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp
22852024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set
22862024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
22872024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
22882024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
22892024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported
22902024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history
22912024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
22922024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status
22932024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address
22942024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address
22952024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
22962024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
22972024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings
22982024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings
22992024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
23002024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy
23012024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy
23022024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles
23032024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name}
23042024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas
23052024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos
23062024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos
23072024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo}
23082024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}
23092024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
23102024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy
23112024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy
23122024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas
23132024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
23142024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository
23152024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version}
23162024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users
23172024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id}
23182024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin
23192024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user}
23202024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos
23212024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo}
23222024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query
23232024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/timeseries/schema
23242024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users
23252024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization
23262024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules
23272024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules
23282024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes
23292024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes
23302024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
23312024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route}
23322024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route}
23332024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers
23342024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers
23352024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router}
23362024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router}
23372024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router}
23382024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets
23392024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets
23402024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
23412024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}
23422024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
23432024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
23442024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs
23452024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs
23462024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc}
23472024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc}
23482024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc}
23492024-11-09T02:47:33.510ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:12228
23502024-11-09T02:47:33.510ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
23512024-11-09T02:47:33.511ZDEBGnexus (nexus-producer-server): registered DTrace probes
23522024-11-09T02:47:33.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
23532024-11-09T02:47:33.512ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23542024-11-09T02:47:33.512ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7132bb08-7b9e-4411-8769-0d7fc828cc09", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
23552024-11-09T02:47:33.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23562024-11-09T02:47:33.513ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
23572024-11-09T02:47:33.514ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:43847 method = GET path = /{producer_id}
23582024-11-09T02:47:33.514ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::b]:43847
23592024-11-09T02:47:33.514ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:43847
23602024-11-09T02:47:33.514ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:43847
23612024-11-09T02:47:33.514ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
23622024-11-09T02:47:33.514ZDEBGnexus (nexus-producer-server): starting producer registration task
23632024-11-09T02:47:33.516ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:43847 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
23642024-11-09T02:47:33.516ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23652024-11-09T02:47:33.516ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
23662024-11-09T02:47:33.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
23672024-11-09T02:47:33.521ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23682024-11-09T02:47:33.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76b1e085-4020-4b64-8ff1-2d9ae7034299", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
23692024-11-09T02:47:33.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23702024-11-09T02:47:33.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23712024-11-09T02:47:33.548ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23722024-11-09T02:47:33.577ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23732024-11-09T02:47:33.578ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3748d498-340f-4095-9436-44bebdd28b31", "content-length": "1", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
23742024-11-09T02:47:33.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23752024-11-09T02:47:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23762024-11-09T02:47:33.581ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 416.062258ms iteration = 3 status = null
23772024-11-09T02:47:33.686ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23782024-11-09T02:47:33.702ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
23792024-11-09T02:47:33.702ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:51945
23802024-11-09T02:47:33.702ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23812024-11-09T02:47:33.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51945 req_id = 9aacdcf9-1f84-401f-a011-33dc291c56d1 roles = RoleSet { roles: {} } uri = /metrics/producers
23822024-11-09T02:47:33.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51945 req_id = 9aacdcf9-1f84-401f-a011-33dc291c56d1 resource = Database result = Ok(()) uri = /metrics/producers
23832024-11-09T02:47:33.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 2a569806-ee30-4f06-aac0-086bde3ffcc2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23842024-11-09T02:47:33.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 2a569806-ee30-4f06-aac0-086bde3ffcc2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23852024-11-09T02:47:33.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 2a569806-ee30-4f06-aac0-086bde3ffcc2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23862024-11-09T02:47:33.739ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
23872024-11-09T02:47:33.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36467 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51945 req_id = 9aacdcf9-1f84-401f-a011-33dc291c56d1 response_code = 201 uri = /metrics/producers
23882024-11-09T02:47:33.739ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9aacdcf9-1f84-401f-a011-33dc291c56d1", "content-length": "41", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
23892024-11-09T02:47:33.741ZDEBGnexus (producer-registration-task): registered with nexus successfully
23902024-11-09T02:47:33.741ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23912024-11-09T02:47:33.758ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23922024-11-09T02:47:33.811ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23932024-11-09T02:47:33.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2ce91331-0597-4d1e-99fd-fcb74085a921", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23942024-11-09T02:47:33.812ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23952024-11-09T02:47:33.813ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "50f9c76c-d376-496a-83e9-56793b1e48ba", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23962024-11-09T02:47:33.813ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23972024-11-09T02:47:33.815ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "98665dc8-771a-40b4-9c99-58cdcfe6901e", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23982024-11-09T02:47:33.815ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
23992024-11-09T02:47:33.817ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24002024-11-09T02:47:33.817ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 410.774009ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24012024-11-09T02:47:33.822ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c662d850-fbae-40e9-905e-0a9d35b1adab", "content-length": "691", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
24022024-11-09T02:47:33.822ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24032024-11-09T02:47:33.822ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24042024-11-09T02:47:33.822ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24052024-11-09T02:47:33.825ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 659.409247ms iteration = 3 status = {}
24062024-11-09T02:47:33.825ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 659.854576ms iteration = 3 status = {}
24072024-11-09T02:47:33.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24082024-11-09T02:47:33.849ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c87c60ff-626d-433b-ab7b-fdbe5ca7d71f", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24092024-11-09T02:47:33.849ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24102024-11-09T02:47:33.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f41eee3b-b73b-4cf9-a80f-5b4786f4a22a", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24112024-11-09T02:47:33.850ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24122024-11-09T02:47:33.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24132024-11-09T02:47:33.851ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24142024-11-09T02:47:33.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.809586ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24152024-11-09T02:47:33.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24162024-11-09T02:47:33.853ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
24172024-11-09T02:47:33.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24182024-11-09T02:47:33.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24192024-11-09T02:47:33.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24202024-11-09T02:47:33.918ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "42ce0830-ee21-4415-916a-2796daf71a27", "content-length": "134", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
24212024-11-09T02:47:33.918ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24222024-11-09T02:47:33.918ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
24232024-11-09T02:47:33.918ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24242024-11-09T02:47:33.918ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24252024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24262024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24272024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24282024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24292024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24302024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24312024-11-09T02:47:33.919ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
24322024-11-09T02:47:33.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24332024-11-09T02:47:33.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24342024-11-09T02:47:33.926ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24352024-11-09T02:47:33.926ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5e42cf8-1731-4732-be8b-39bdc9f17d3b", "content-length": "2", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
24362024-11-09T02:47:33.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24372024-11-09T02:47:33.927ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f81563b-10b2-45bb-900c-d30ff1e952e8", "content-length": "52", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
24382024-11-09T02:47:33.927ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
24392024-11-09T02:47:33.927ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24402024-11-09T02:47:34.054ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1d533ed6-c5f9-496f-a4db-f3607d997321", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
24412024-11-09T02:47:34.054ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
24422024-11-09T02:47:34.054ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24432024-11-09T02:47:34.055ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "03edff10-8708-4759-9a13-613e210974c3", "content-length": "682", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
24442024-11-09T02:47:34.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24452024-11-09T02:47:34.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24462024-11-09T02:47:34.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24472024-11-09T02:47:34.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24482024-11-09T02:47:34.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24492024-11-09T02:47:34.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24502024-11-09T02:47:34.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24512024-11-09T02:47:34.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24522024-11-09T02:47:34.087ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 921.530395ms iteration = 3 status = {}
24532024-11-09T02:47:34.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0624bd8a-0a7f-4185-b328-7f05a0405683 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24542024-11-09T02:47:34.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0624bd8a-0a7f-4185-b328-7f05a0405683 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24552024-11-09T02:47:34.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0624bd8a-0a7f-4185-b328-7f05a0405683 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24562024-11-09T02:47:35.224ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:43847 remote_addr = [fd00:1122:3344:101::d]:51332
24572024-11-09T02:47:35.226ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1358 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 40369744-b748-4544-ae25-461372d1d3de response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
24582024-11-09T02:47:35.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cc0eda64-fecc-459f-9888-5f8656c6fc68 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24592024-11-09T02:47:35.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cc0eda64-fecc-459f-9888-5f8656c6fc68 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24602024-11-09T02:47:35.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cc0eda64-fecc-459f-9888-5f8656c6fc68 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24612024-11-09T02:47:36.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4a4cd818-f75d-4beb-ac44-9858c9a0b17b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24622024-11-09T02:47:36.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4a4cd818-f75d-4beb-ac44-9858c9a0b17b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24632024-11-09T02:47:36.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4a4cd818-f75d-4beb-ac44-9858c9a0b17b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24642024-11-09T02:47:37.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac8746af-c433-43c0-bb80-124c417db2d1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24652024-11-09T02:47:37.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac8746af-c433-43c0-bb80-124c417db2d1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24662024-11-09T02:47:37.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac8746af-c433-43c0-bb80-124c417db2d1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24672024-11-09T02:47:38.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bb437534-141e-4025-86ee-e39ba8f18d04 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24682024-11-09T02:47:38.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bb437534-141e-4025-86ee-e39ba8f18d04 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24692024-11-09T02:47:38.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bb437534-141e-4025-86ee-e39ba8f18d04 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24702024-11-09T02:47:39.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7f243f02-7b78-4ad4-80c8-1529a6abb245 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24712024-11-09T02:47:39.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7f243f02-7b78-4ad4-80c8-1529a6abb245 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24722024-11-09T02:47:39.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7f243f02-7b78-4ad4-80c8-1529a6abb245 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24732024-11-09T02:47:40.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4136cf98-f7b4-45cb-9b98-063683182f9d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24742024-11-09T02:47:40.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4136cf98-f7b4-45cb-9b98-063683182f9d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24752024-11-09T02:47:40.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4136cf98-f7b4-45cb-9b98-063683182f9d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24762024-11-09T02:47:41.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b49c9903-8a6f-4170-89a6-9b80f5393a89 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24772024-11-09T02:47:41.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b49c9903-8a6f-4170-89a6-9b80f5393a89 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24782024-11-09T02:47:41.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b49c9903-8a6f-4170-89a6-9b80f5393a89 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24792024-11-09T02:47:42.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dc2660a8-c36c-4769-9837-7abdc738f320 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24802024-11-09T02:47:42.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dc2660a8-c36c-4769-9837-7abdc738f320 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24812024-11-09T02:47:42.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dc2660a8-c36c-4769-9837-7abdc738f320 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
24822024-11-09T02:47:43.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
24832024-11-09T02:47:43.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
24842024-11-09T02:47:43.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24852024-11-09T02:47:43.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24862024-11-09T02:47:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24872024-11-09T02:47:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24882024-11-09T02:47:43.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24892024-11-09T02:47:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24902024-11-09T02:47:43.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24912024-11-09T02:47:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24922024-11-09T02:47:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24932024-11-09T02:47:43.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24942024-11-09T02:47:43.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24952024-11-09T02:47:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24962024-11-09T02:47:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24972024-11-09T02:47:43.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
24982024-11-09T02:47:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24992024-11-09T02:47:43.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25002024-11-09T02:47:43.188ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
25012024-11-09T02:47:43.188ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.2304ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
25022024-11-09T02:47:43.197ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.540222ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25032024-11-09T02:47:43.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a07a6e01-5f1d-4dbd-bf05-5a7666c52675 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25042024-11-09T02:47:43.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a07a6e01-5f1d-4dbd-bf05-5a7666c52675 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25052024-11-09T02:47:43.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a07a6e01-5f1d-4dbd-bf05-5a7666c52675 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25062024-11-09T02:47:44.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 532f5123-ee19-4f5f-ba41-2efa3abd9cb4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25072024-11-09T02:47:44.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 532f5123-ee19-4f5f-ba41-2efa3abd9cb4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25082024-11-09T02:47:44.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 532f5123-ee19-4f5f-ba41-2efa3abd9cb4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25092024-11-09T02:47:45.224ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 440 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 37455d8d-c2d4-44c0-82cb-6cad005e46ba response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
25102024-11-09T02:47:45.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 780ebf2e-f9e4-41c9-81e6-62a871577c81 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25112024-11-09T02:47:45.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 780ebf2e-f9e4-41c9-81e6-62a871577c81 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25122024-11-09T02:47:45.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 780ebf2e-f9e4-41c9-81e6-62a871577c81 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25132024-11-09T02:47:46.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a5d2800-914c-49a7-8d08-aaac5e8060ad roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25142024-11-09T02:47:46.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a5d2800-914c-49a7-8d08-aaac5e8060ad resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25152024-11-09T02:47:46.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a5d2800-914c-49a7-8d08-aaac5e8060ad response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25162024-11-09T02:47:47.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b3e1ef6f-7bc8-488b-a57a-c9a2c8dd8b3f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25172024-11-09T02:47:47.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b3e1ef6f-7bc8-488b-a57a-c9a2c8dd8b3f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25182024-11-09T02:47:47.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b3e1ef6f-7bc8-488b-a57a-c9a2c8dd8b3f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25192024-11-09T02:47:48.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a47856c2-6f97-4cae-8301-690b7606e4f4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25202024-11-09T02:47:48.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a47856c2-6f97-4cae-8301-690b7606e4f4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25212024-11-09T02:47:48.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a47856c2-6f97-4cae-8301-690b7606e4f4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25222024-11-09T02:47:49.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5e924ed8-2e3a-4df0-87c3-79b84c7a019f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25232024-11-09T02:47:49.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5e924ed8-2e3a-4df0-87c3-79b84c7a019f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25242024-11-09T02:47:49.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5e924ed8-2e3a-4df0-87c3-79b84c7a019f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25252024-11-09T02:47:50.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d5b2fac-08bb-4abe-86f8-8b771cde6ae5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25262024-11-09T02:47:50.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d5b2fac-08bb-4abe-86f8-8b771cde6ae5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25272024-11-09T02:47:50.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d5b2fac-08bb-4abe-86f8-8b771cde6ae5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25282024-11-09T02:47:51.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ec45cc4-944d-4183-aecf-db60abc93305 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25292024-11-09T02:47:51.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ec45cc4-944d-4183-aecf-db60abc93305 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25302024-11-09T02:47:51.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ec45cc4-944d-4183-aecf-db60abc93305 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25312024-11-09T02:47:52.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bd73d236-d310-4e63-893b-11515eab285c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25322024-11-09T02:47:52.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bd73d236-d310-4e63-893b-11515eab285c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25332024-11-09T02:47:52.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bd73d236-d310-4e63-893b-11515eab285c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25342024-11-09T02:47:53.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
25352024-11-09T02:47:53.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
25362024-11-09T02:47:53.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25372024-11-09T02:47:53.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25382024-11-09T02:47:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25392024-11-09T02:47:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25402024-11-09T02:47:53.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412024-11-09T02:47:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25422024-11-09T02:47:53.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25432024-11-09T02:47:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25442024-11-09T02:47:53.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25452024-11-09T02:47:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25462024-11-09T02:47:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25472024-11-09T02:47:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
25482024-11-09T02:47:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25492024-11-09T02:47:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25502024-11-09T02:47:53.187ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
25512024-11-09T02:47:53.187ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.958863ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
25522024-11-09T02:47:53.198ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25532024-11-09T02:47:53.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25542024-11-09T02:47:53.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.246774ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25552024-11-09T02:47:53.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95e674f6-c5c8-453e-a6f6-09fa5e357b61 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25562024-11-09T02:47:53.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95e674f6-c5c8-453e-a6f6-09fa5e357b61 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25572024-11-09T02:47:53.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95e674f6-c5c8-453e-a6f6-09fa5e357b61 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25582024-11-09T02:47:54.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e7ab4f5-4ff9-463e-8c18-62cb780c8627 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25592024-11-09T02:47:54.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e7ab4f5-4ff9-463e-8c18-62cb780c8627 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25602024-11-09T02:47:54.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e7ab4f5-4ff9-463e-8c18-62cb780c8627 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25612024-11-09T02:47:55.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b829f472-7dbb-4441-a20d-6b0fbb57b178 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25622024-11-09T02:47:55.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b829f472-7dbb-4441-a20d-6b0fbb57b178 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25632024-11-09T02:47:55.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b829f472-7dbb-4441-a20d-6b0fbb57b178 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25642024-11-09T02:47:56.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d37de24-a348-46bc-8985-5306061d5768 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25652024-11-09T02:47:56.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d37de24-a348-46bc-8985-5306061d5768 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25662024-11-09T02:47:56.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d37de24-a348-46bc-8985-5306061d5768 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25672024-11-09T02:47:57.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41922551-d6ed-41e1-92d6-d4d5bb73dde2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25682024-11-09T02:47:57.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41922551-d6ed-41e1-92d6-d4d5bb73dde2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25692024-11-09T02:47:57.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41922551-d6ed-41e1-92d6-d4d5bb73dde2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25702024-11-09T02:47:58.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cd335bce-df5f-4e71-b9d7-a124f43eefab roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25712024-11-09T02:47:58.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cd335bce-df5f-4e71-b9d7-a124f43eefab resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25722024-11-09T02:47:58.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cd335bce-df5f-4e71-b9d7-a124f43eefab response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25732024-11-09T02:47:59.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12f12794-ec1a-4550-a1d5-ffbed6f93f7c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25742024-11-09T02:47:59.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12f12794-ec1a-4550-a1d5-ffbed6f93f7c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25752024-11-09T02:47:59.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12f12794-ec1a-4550-a1d5-ffbed6f93f7c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25762024-11-09T02:48:00.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 900 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 895acbdd-e751-475b-b30c-69ad212a34f2 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
25772024-11-09T02:48:01.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81405de5-05b0-4bde-9315-643ce468ff5f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25782024-11-09T02:48:01.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81405de5-05b0-4bde-9315-643ce468ff5f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25792024-11-09T02:48:01.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81405de5-05b0-4bde-9315-643ce468ff5f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25802024-11-09T02:48:02.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7bfc5d4-4f1a-4b62-91e1-72b7e902bee4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25812024-11-09T02:48:02.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7bfc5d4-4f1a-4b62-91e1-72b7e902bee4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25822024-11-09T02:48:02.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7bfc5d4-4f1a-4b62-91e1-72b7e902bee4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25832024-11-09T02:48:03.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e06a4ec6-8867-474f-8f44-523cc430b275 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25842024-11-09T02:48:03.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e06a4ec6-8867-474f-8f44-523cc430b275 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25852024-11-09T02:48:03.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e06a4ec6-8867-474f-8f44-523cc430b275 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
25862024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
25872024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
25882024-11-09T02:48:03.166ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25892024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25902024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25912024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
25922024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
25932024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25942024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
25952024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25962024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25972024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
25982024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25992024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
26002024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
26012024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26022024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
26032024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26042024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
26052024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26062024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26072024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
26082024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26092024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
26102024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
26112024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26122024-11-09T02:48:03.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26132024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26142024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26152024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26162024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26172024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26182024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26192024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26202024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26212024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26222024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26232024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26242024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26252024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
26262024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
26272024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
26282024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.06\u{b5}s iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26292024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.06\u{b5}s iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
26302024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.06\u{b5}s iteration = 4 status = {"errors":[],"records_set_to_done":[]}
26312024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
26322024-11-09T02:48:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.9\u{b5}s iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26332024-11-09T02:48:03.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26342024-11-09T02:48:03.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-11-09T02:48:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26362024-11-09T02:48:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26372024-11-09T02:48:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.161986ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26382024-11-09T02:48:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26392024-11-09T02:48:03.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26402024-11-09T02:48:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26412024-11-09T02:48:03.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26422024-11-09T02:48:03.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26432024-11-09T02:48:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26442024-11-09T02:48:03.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452024-11-09T02:48:03.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 986, tv_nsec: 517904842 } })
26462024-11-09T02:48:03.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
26472024-11-09T02:48:03.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26482024-11-09T02:48:03.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26492024-11-09T02:48:03.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502024-11-09T02:48:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26512024-11-09T02:48:03.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26522024-11-09T02:48:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26532024-11-09T02:48:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26542024-11-09T02:48:03.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26552024-11-09T02:48:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26562024-11-09T02:48:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26572024-11-09T02:48:03.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26582024-11-09T02:48:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26592024-11-09T02:48:03.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26602024-11-09T02:48:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26612024-11-09T02:48:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26622024-11-09T02:48:03.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26632024-11-09T02:48:03.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26642024-11-09T02:48:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26652024-11-09T02:48:03.186ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26662024-11-09T02:48:03.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26672024-11-09T02:48:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26682024-11-09T02:48:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26692024-11-09T02:48:03.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26702024-11-09T02:48:03.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26712024-11-09T02:48:03.188ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 986, tv_nsec: 528285066 } })
26722024-11-09T02:48:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26732024-11-09T02:48:03.188ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 986, tv_nsec: 528468190 } })
26742024-11-09T02:48:03.188ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
26752024-11-09T02:48:03.188ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
26762024-11-09T02:48:03.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26772024-11-09T02:48:03.192ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26782024-11-09T02:48:03.192ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.140811ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26792024-11-09T02:48:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26802024-11-09T02:48:03.193ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26812024-11-09T02:48:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26822024-11-09T02:48:03.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26832024-11-09T02:48:03.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26842024-11-09T02:48:03.212ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26852024-11-09T02:48:03.212ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26862024-11-09T02:48:03.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26872024-11-09T02:48:03.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26882024-11-09T02:48:03.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26892024-11-09T02:48:03.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26902024-11-09T02:48:03.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26912024-11-09T02:48:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26922024-11-09T02:48:03.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.178637ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26932024-11-09T02:48:03.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26942024-11-09T02:48:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
26952024-11-09T02:48:03.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26962024-11-09T02:48:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26972024-11-09T02:48:03.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.873645ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26982024-11-09T02:48:03.224ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.745433ms iteration = 4 status = 0
26992024-11-09T02:48:03.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27002024-11-09T02:48:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27012024-11-09T02:48:03.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27022024-11-09T02:48:03.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
27032024-11-09T02:48:03.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27042024-11-09T02:48:03.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27052024-11-09T02:48:03.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
27062024-11-09T02:48:03.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.220183ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
27072024-11-09T02:48:03.262ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27082024-11-09T02:48:03.262ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27092024-11-09T02:48:03.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27102024-11-09T02:48:03.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27112024-11-09T02:48:03.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
27122024-11-09T02:48:03.264ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27132024-11-09T02:48:03.264ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c65c8ba-6451-4a83-824d-21c964c6217b", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27142024-11-09T02:48:03.264ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27152024-11-09T02:48:03.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27162024-11-09T02:48:03.294ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27172024-11-09T02:48:03.294ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27182024-11-09T02:48:03.294ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.7572ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27192024-11-09T02:48:03.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
27202024-11-09T02:48:03.303ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27212024-11-09T02:48:03.303ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "069aa7e0-b99a-4772-9730-50df3393ec11", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27222024-11-09T02:48:03.303ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27232024-11-09T02:48:03.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
27242024-11-09T02:48:03.319ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 152.718196ms iteration = 6 status = {"physical_disks_added":0}
27252024-11-09T02:48:03.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
27262024-11-09T02:48:03.324ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27272024-11-09T02:48:03.325ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "771e6e32-1885-488d-9a0f-50f6fc0aca75", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27282024-11-09T02:48:03.325ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27292024-11-09T02:48:03.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27302024-11-09T02:48:03.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27312024-11-09T02:48:03.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27322024-11-09T02:48:03.370ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27332024-11-09T02:48:03.370ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27342024-11-09T02:48:03.370ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c12f04a-d751-4d0b-9a41-853ebd33ab74", "content-length": "372", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27352024-11-09T02:48:03.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27362024-11-09T02:48:03.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27372024-11-09T02:48:03.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27382024-11-09T02:48:03.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27392024-11-09T02:48:03.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27402024-11-09T02:48:03.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27412024-11-09T02:48:03.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27422024-11-09T02:48:03.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27432024-11-09T02:48:03.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27442024-11-09T02:48:03.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27452024-11-09T02:48:03.385ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27462024-11-09T02:48:03.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c03f99ea-3100-4b01-a816-77c7790b5db7", "content-length": "1", "date": "Sat, 09 Nov 2024 02:48:02 GMT"} })
27472024-11-09T02:48:03.387ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27482024-11-09T02:48:03.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27492024-11-09T02:48:03.389ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 222.685462ms iteration = 4 status = null
27502024-11-09T02:48:03.399ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 232.938193ms iteration = 4 status = {}
27512024-11-09T02:48:03.417ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27522024-11-09T02:48:03.417ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27532024-11-09T02:48:03.417ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6238e4ef-43f7-47c2-aa0e-444a876fd173", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27542024-11-09T02:48:03.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27552024-11-09T02:48:03.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27562024-11-09T02:48:03.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27572024-11-09T02:48:03.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27582024-11-09T02:48:03.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27592024-11-09T02:48:03.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27602024-11-09T02:48:03.426ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27612024-11-09T02:48:03.426ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27622024-11-09T02:48:03.427ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "76087155-12fb-477a-9528-5eba61583451", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27632024-11-09T02:48:03.428ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.989624ms iteration = 4 status = {}
27642024-11-09T02:48:03.435ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27652024-11-09T02:48:03.435ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "797fa650-4473-4173-bf68-48d8fdbdf7d4", "content-length": "691", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27662024-11-09T02:48:03.435ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27672024-11-09T02:48:03.435ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27682024-11-09T02:48:03.435ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27692024-11-09T02:48:03.437ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 270.473839ms iteration = 4 status = {}
27702024-11-09T02:48:03.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27712024-11-09T02:48:03.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27722024-11-09T02:48:03.464ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
27732024-11-09T02:48:03.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27742024-11-09T02:48:03.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27752024-11-09T02:48:03.474ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27762024-11-09T02:48:03.474ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6e9282-976d-4754-9ad1-807da00a9e32", "content-length": "134", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27772024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27782024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
27792024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27802024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27812024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27822024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27832024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27842024-11-09T02:48:03.474ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27852024-11-09T02:48:03.475ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27862024-11-09T02:48:03.475ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27872024-11-09T02:48:03.475ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
27882024-11-09T02:48:03.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27892024-11-09T02:48:03.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27902024-11-09T02:48:03.478ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27912024-11-09T02:48:03.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "85fcddbb-6594-4697-b263-0312a3ddbdb3", "content-length": "2", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27922024-11-09T02:48:03.478ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27932024-11-09T02:48:03.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f388e0b-9978-4332-ab6c-54eabec23cec", "content-length": "52", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27942024-11-09T02:48:03.478ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
27952024-11-09T02:48:03.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27962024-11-09T02:48:03.655ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2e7be5a4-d896-4b91-8d1a-21fa437e9ff6", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
27972024-11-09T02:48:03.655ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
27982024-11-09T02:48:03.655ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27992024-11-09T02:48:03.660ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "becfba90-3d91-4b26-8b54-72b3da055517", "content-length": "682", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
28002024-11-09T02:48:03.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28012024-11-09T02:48:03.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28022024-11-09T02:48:03.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28032024-11-09T02:48:03.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28042024-11-09T02:48:03.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28052024-11-09T02:48:03.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28062024-11-09T02:48:03.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28072024-11-09T02:48:03.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28082024-11-09T02:48:03.676ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 510.03343ms iteration = 4 status = {}
28092024-11-09T02:48:03.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 2766702e-642e-4542-9388-fdcd29ddc54d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28102024-11-09T02:48:03.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 2766702e-642e-4542-9388-fdcd29ddc54d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28112024-11-09T02:48:03.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 2766702e-642e-4542-9388-fdcd29ddc54d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28122024-11-09T02:48:04.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 790733f4-e9ce-4692-890b-94c1e43b092a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28132024-11-09T02:48:04.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 790733f4-e9ce-4692-890b-94c1e43b092a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28142024-11-09T02:48:04.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 790733f4-e9ce-4692-890b-94c1e43b092a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28152024-11-09T02:48:05.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 902c39d7-96b4-4fa1-8d6c-e016507ea840 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28162024-11-09T02:48:05.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 902c39d7-96b4-4fa1-8d6c-e016507ea840 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28172024-11-09T02:48:05.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 902c39d7-96b4-4fa1-8d6c-e016507ea840 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28182024-11-09T02:48:06.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63d42f6b-d54e-4941-a330-de5b0f934d21 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28192024-11-09T02:48:06.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63d42f6b-d54e-4941-a330-de5b0f934d21 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28202024-11-09T02:48:06.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63d42f6b-d54e-4941-a330-de5b0f934d21 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28212024-11-09T02:48:07.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2315d087-79fe-41ad-9872-56ff902f08a3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28222024-11-09T02:48:07.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2315d087-79fe-41ad-9872-56ff902f08a3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28232024-11-09T02:48:07.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2315d087-79fe-41ad-9872-56ff902f08a3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28242024-11-09T02:48:08.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b905f55-4662-44db-a101-1992e30cd103 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28252024-11-09T02:48:08.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b905f55-4662-44db-a101-1992e30cd103 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28262024-11-09T02:48:08.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b905f55-4662-44db-a101-1992e30cd103 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28272024-11-09T02:48:09.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaf3df5a-c920-4561-864b-9cf9646454f8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28282024-11-09T02:48:09.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaf3df5a-c920-4561-864b-9cf9646454f8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28292024-11-09T02:48:09.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaf3df5a-c920-4561-864b-9cf9646454f8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28302024-11-09T02:48:10.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eae4c32a-d5b3-42ee-9c77-029e01aaa866 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28312024-11-09T02:48:10.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eae4c32a-d5b3-42ee-9c77-029e01aaa866 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28322024-11-09T02:48:10.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eae4c32a-d5b3-42ee-9c77-029e01aaa866 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28332024-11-09T02:48:11.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3bcd1f1b-5046-43b3-8162-d063bcd61ee5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28342024-11-09T02:48:11.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3bcd1f1b-5046-43b3-8162-d063bcd61ee5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28352024-11-09T02:48:11.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3bcd1f1b-5046-43b3-8162-d063bcd61ee5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28362024-11-09T02:48:12.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 31b33311-45a7-494c-bf8b-672204ccbc00 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28372024-11-09T02:48:12.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 31b33311-45a7-494c-bf8b-672204ccbc00 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28382024-11-09T02:48:12.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 31b33311-45a7-494c-bf8b-672204ccbc00 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28392024-11-09T02:48:13.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
28402024-11-09T02:48:13.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
28412024-11-09T02:48:13.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28422024-11-09T02:48:13.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28432024-11-09T02:48:13.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28442024-11-09T02:48:13.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28452024-11-09T02:48:13.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28462024-11-09T02:48:13.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28472024-11-09T02:48:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28482024-11-09T02:48:13.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.454932ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28492024-11-09T02:48:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28502024-11-09T02:48:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28512024-11-09T02:48:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28522024-11-09T02:48:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28532024-11-09T02:48:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28542024-11-09T02:48:13.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28552024-11-09T02:48:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
28562024-11-09T02:48:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28572024-11-09T02:48:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28582024-11-09T02:48:13.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
28592024-11-09T02:48:13.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.341871ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
28602024-11-09T02:48:13.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f78ce7d9-5dc0-401e-b20a-5f58c545973a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28612024-11-09T02:48:13.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f78ce7d9-5dc0-401e-b20a-5f58c545973a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28622024-11-09T02:48:13.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f78ce7d9-5dc0-401e-b20a-5f58c545973a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28632024-11-09T02:48:14.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f1696137-1ffa-4f42-8b02-0c1e3cd9eb7b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28642024-11-09T02:48:14.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f1696137-1ffa-4f42-8b02-0c1e3cd9eb7b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28652024-11-09T02:48:14.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f1696137-1ffa-4f42-8b02-0c1e3cd9eb7b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28662024-11-09T02:48:15.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 731 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 6c71fde0-0c3e-4b28-8194-4097eb26ab91 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
28672024-11-09T02:48:15.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aca4754e-cc84-49ef-91cc-ccf5ace452eb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28682024-11-09T02:48:15.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aca4754e-cc84-49ef-91cc-ccf5ace452eb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28692024-11-09T02:48:15.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aca4754e-cc84-49ef-91cc-ccf5ace452eb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28702024-11-09T02:48:16.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a8a4388a-e4fa-4853-884e-dec8b8bab69c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28712024-11-09T02:48:16.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a8a4388a-e4fa-4853-884e-dec8b8bab69c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28722024-11-09T02:48:16.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a8a4388a-e4fa-4853-884e-dec8b8bab69c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28732024-11-09T02:48:17.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 88243612-1b91-4ba4-89be-2dbeb8b931db roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28742024-11-09T02:48:17.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 88243612-1b91-4ba4-89be-2dbeb8b931db resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28752024-11-09T02:48:17.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 88243612-1b91-4ba4-89be-2dbeb8b931db response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28762024-11-09T02:48:18.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9a0ff88e-04b7-469d-a487-334d59411cae roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28772024-11-09T02:48:18.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9a0ff88e-04b7-469d-a487-334d59411cae resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28782024-11-09T02:48:18.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9a0ff88e-04b7-469d-a487-334d59411cae response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28792024-11-09T02:48:19.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5a766695-aa7f-4473-b5ec-aad8785b294a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28802024-11-09T02:48:19.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5a766695-aa7f-4473-b5ec-aad8785b294a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28812024-11-09T02:48:19.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5a766695-aa7f-4473-b5ec-aad8785b294a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28822024-11-09T02:48:20.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63245db3-2b47-4462-8888-67c261d389ac roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28832024-11-09T02:48:20.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63245db3-2b47-4462-8888-67c261d389ac resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28842024-11-09T02:48:20.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63245db3-2b47-4462-8888-67c261d389ac response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28852024-11-09T02:48:21.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e577952a-4417-4b5f-a6e8-94ce3fbd1005 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28862024-11-09T02:48:21.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e577952a-4417-4b5f-a6e8-94ce3fbd1005 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28872024-11-09T02:48:21.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e577952a-4417-4b5f-a6e8-94ce3fbd1005 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28882024-11-09T02:48:22.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7bada3ff-3de9-4ef8-a2e6-e8e26e9a1235 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28892024-11-09T02:48:22.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7bada3ff-3de9-4ef8-a2e6-e8e26e9a1235 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28902024-11-09T02:48:22.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7bada3ff-3de9-4ef8-a2e6-e8e26e9a1235 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
28912024-11-09T02:48:23.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
28922024-11-09T02:48:23.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
28932024-11-09T02:48:23.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28942024-11-09T02:48:23.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28952024-11-09T02:48:23.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28962024-11-09T02:48:23.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28972024-11-09T02:48:23.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28982024-11-09T02:48:23.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28992024-11-09T02:48:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29002024-11-09T02:48:23.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.30398ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29012024-11-09T02:48:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29022024-11-09T02:48:23.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29032024-11-09T02:48:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29042024-11-09T02:48:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29052024-11-09T02:48:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29062024-11-09T02:48:23.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29072024-11-09T02:48:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
29082024-11-09T02:48:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29092024-11-09T02:48:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29102024-11-09T02:48:23.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
29112024-11-09T02:48:23.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.933204ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
29122024-11-09T02:48:23.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9879f84-6701-418d-b307-fa04df2ee253 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29132024-11-09T02:48:23.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9879f84-6701-418d-b307-fa04df2ee253 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29142024-11-09T02:48:23.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9879f84-6701-418d-b307-fa04df2ee253 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29152024-11-09T02:48:24.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 27b4d0dc-4cec-4354-ac89-f7e8b73643b1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29162024-11-09T02:48:24.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 27b4d0dc-4cec-4354-ac89-f7e8b73643b1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29172024-11-09T02:48:24.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 27b4d0dc-4cec-4354-ac89-f7e8b73643b1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29182024-11-09T02:48:25.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a974f249-4646-4ea7-836c-781b4faf3443 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29192024-11-09T02:48:25.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a974f249-4646-4ea7-836c-781b4faf3443 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29202024-11-09T02:48:25.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a974f249-4646-4ea7-836c-781b4faf3443 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29212024-11-09T02:48:26.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0096bd5d-fdb9-4e06-987c-fb847f5f4486 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29222024-11-09T02:48:26.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0096bd5d-fdb9-4e06-987c-fb847f5f4486 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29232024-11-09T02:48:26.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0096bd5d-fdb9-4e06-987c-fb847f5f4486 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29242024-11-09T02:48:27.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 51e411a3-d868-43c4-8a07-4127f77fe183 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29252024-11-09T02:48:27.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 51e411a3-d868-43c4-8a07-4127f77fe183 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29262024-11-09T02:48:27.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 51e411a3-d868-43c4-8a07-4127f77fe183 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29272024-11-09T02:48:28.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df5dfa2c-e898-4630-9966-3160678c39bc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29282024-11-09T02:48:28.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df5dfa2c-e898-4630-9966-3160678c39bc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29292024-11-09T02:48:28.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df5dfa2c-e898-4630-9966-3160678c39bc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29302024-11-09T02:48:29.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2249d729-82de-4410-90c2-d9f0f30f721b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29312024-11-09T02:48:29.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2249d729-82de-4410-90c2-d9f0f30f721b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29322024-11-09T02:48:29.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2249d729-82de-4410-90c2-d9f0f30f721b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29332024-11-09T02:48:30.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 527 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 074cf74d-ab10-400d-b623-0bc7997035f0 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
29342024-11-09T02:48:30.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 77b991a4-f7f1-4c1d-bf36-f43b67f5b16b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29352024-11-09T02:48:30.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 77b991a4-f7f1-4c1d-bf36-f43b67f5b16b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29362024-11-09T02:48:30.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 77b991a4-f7f1-4c1d-bf36-f43b67f5b16b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29372024-11-09T02:48:31.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b7b6e37d-4f04-4709-8b7c-618e15e9b66f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29382024-11-09T02:48:31.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b7b6e37d-4f04-4709-8b7c-618e15e9b66f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29392024-11-09T02:48:31.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b7b6e37d-4f04-4709-8b7c-618e15e9b66f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29402024-11-09T02:48:32.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fcc2499-1c77-49cf-9cb6-210df4ba482e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29412024-11-09T02:48:32.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fcc2499-1c77-49cf-9cb6-210df4ba482e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29422024-11-09T02:48:32.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fcc2499-1c77-49cf-9cb6-210df4ba482e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
29432024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
29442024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29452024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
29462024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29472024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
29482024-11-09T02:48:33.166ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29492024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29502024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
29512024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29522024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29532024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
29542024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29552024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
29562024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
29572024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29582024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
29592024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29602024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29612024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
29622024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
29632024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29642024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29652024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29662024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
29672024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29682024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
29692024-11-09T02:48:33.166ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
29702024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.95\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
29712024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
29722024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
29732024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
29742024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29752024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
29762024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29772024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
29782024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
29792024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29802024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29812024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
29822024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
29832024-11-09T02:48:33.166ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29842024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29852024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
29862024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29872024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
29882024-11-09T02:48:33.166ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:38:33.166753092 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29892024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
29902024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
29912024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
29922024-11-09T02:48:33.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29932024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29942024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29952024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29962024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29972024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29982024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29992024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30002024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30012024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30022024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30032024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30042024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
30052024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
30062024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.55\u{b5}s iteration = 5 status = {"errors":[],"records_set_to_done":[]}
30072024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30082024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30092024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
30102024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.12\u{b5}s iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30112024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
30122024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
30132024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30142024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
30152024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.9\u{b5}s iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
30162024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30172024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30182024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.56\u{b5}s iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30192024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30202024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30212024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30222024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30232024-11-09T02:48:33.167ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 507456146 } })
30242024-11-09T02:48:33.167ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 507494896 } })
30252024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30262024-11-09T02:48:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30272024-11-09T02:48:33.168ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
30282024-11-09T02:48:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.42143ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
30292024-11-09T02:48:33.168ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
30302024-11-09T02:48:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.530761ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
30312024-11-09T02:48:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30322024-11-09T02:48:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30332024-11-09T02:48:33.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342024-11-09T02:48:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.429042ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30352024-11-09T02:48:33.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30362024-11-09T02:48:33.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30372024-11-09T02:48:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30382024-11-09T02:48:33.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30392024-11-09T02:48:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30402024-11-09T02:48:33.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30412024-11-09T02:48:33.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30422024-11-09T02:48:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30432024-11-09T02:48:33.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30442024-11-09T02:48:33.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30452024-11-09T02:48:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30462024-11-09T02:48:33.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30472024-11-09T02:48:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30482024-11-09T02:48:33.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30492024-11-09T02:48:33.182ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30502024-11-09T02:48:33.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30512024-11-09T02:48:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30522024-11-09T02:48:33.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30532024-11-09T02:48:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30542024-11-09T02:48:33.188ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 528154554 } })
30552024-11-09T02:48:33.188ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
30562024-11-09T02:48:33.188ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:38:33.166753092 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30572024-11-09T02:48:33.188ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.020555ms iteration = 3 status = {"expiration":"2024-11-09T02:38:33.166753092Z","pruned":[]}
30582024-11-09T02:48:33.190ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 530690156 } })
30592024-11-09T02:48:33.190ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
30602024-11-09T02:48:33.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30612024-11-09T02:48:33.192ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.301423ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
30622024-11-09T02:48:33.194ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30632024-11-09T02:48:33.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30642024-11-09T02:48:33.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30652024-11-09T02:48:33.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30662024-11-09T02:48:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30672024-11-09T02:48:33.199ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30682024-11-09T02:48:33.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30692024-11-09T02:48:33.201ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30702024-11-09T02:48:33.201ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30712024-11-09T02:48:33.201ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 34.638216ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30722024-11-09T02:48:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30732024-11-09T02:48:33.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30742024-11-09T02:48:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30752024-11-09T02:48:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30762024-11-09T02:48:33.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30772024-11-09T02:48:33.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30782024-11-09T02:48:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30792024-11-09T02:48:33.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30802024-11-09T02:48:33.208ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30812024-11-09T02:48:33.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30822024-11-09T02:48:33.228ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30832024-11-09T02:48:33.228ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30842024-11-09T02:48:33.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30852024-11-09T02:48:33.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30862024-11-09T02:48:33.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872024-11-09T02:48:33.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30882024-11-09T02:48:33.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30892024-11-09T02:48:33.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30902024-11-09T02:48:33.234ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30912024-11-09T02:48:33.234ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30922024-11-09T02:48:33.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30932024-11-09T02:48:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30942024-11-09T02:48:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30952024-11-09T02:48:33.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30962024-11-09T02:48:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30972024-11-09T02:48:33.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30982024-11-09T02:48:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30992024-11-09T02:48:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31002024-11-09T02:48:33.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31012024-11-09T02:48:33.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31022024-11-09T02:48:33.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 582117389 } })
31032024-11-09T02:48:33.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
31042024-11-09T02:48:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31052024-11-09T02:48:33.243ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31062024-11-09T02:48:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31072024-11-09T02:48:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31082024-11-09T02:48:33.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31092024-11-09T02:48:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31102024-11-09T02:48:33.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-11-09T02:48:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31122024-11-09T02:48:33.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31132024-11-09T02:48:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31142024-11-09T02:48:33.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31152024-11-09T02:48:33.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31162024-11-09T02:48:33.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.419563ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31172024-11-09T02:48:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
31182024-11-09T02:48:33.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31192024-11-09T02:48:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31202024-11-09T02:48:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31212024-11-09T02:48:33.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31222024-11-09T02:48:33.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31232024-11-09T02:48:33.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31242024-11-09T02:48:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31252024-11-09T02:48:33.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31272024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31282024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31292024-11-09T02:48:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31302024-11-09T02:48:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31312024-11-09T02:48:33.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31322024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31332024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
31342024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.428333ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
31352024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31362024-11-09T02:48:33.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.189321ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31372024-11-09T02:48:33.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
31382024-11-09T02:48:33.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31392024-11-09T02:48:33.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31402024-11-09T02:48:33.284ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
31412024-11-09T02:48:33.284ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 118.387777ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31422024-11-09T02:48:33.286ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.352268ms iteration = 5 status = 0
31432024-11-09T02:48:33.290ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31442024-11-09T02:48:33.290ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31452024-11-09T02:48:33.290ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.88093ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31462024-11-09T02:48:33.290ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31472024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31482024-11-09T02:48:33.293ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31492024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 126.583296ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31502024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31512024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31522024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31532024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31542024-11-09T02:48:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31552024-11-09T02:48:33.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562024-11-09T02:48:33.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31572024-11-09T02:48:33.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31582024-11-09T02:48:33.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31592024-11-09T02:48:33.304ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31602024-11-09T02:48:33.304ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 138.202826ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31612024-11-09T02:48:33.314ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31622024-11-09T02:48:33.314ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31632024-11-09T02:48:33.314ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31642024-11-09T02:48:33.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31652024-11-09T02:48:33.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31662024-11-09T02:48:33.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672024-11-09T02:48:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31682024-11-09T02:48:33.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31692024-11-09T02:48:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31702024-11-09T02:48:33.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31712024-11-09T02:48:33.325ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31722024-11-09T02:48:33.325ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31732024-11-09T02:48:33.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31742024-11-09T02:48:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31752024-11-09T02:48:33.334ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
31762024-11-09T02:48:33.334ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31772024-11-09T02:48:33.334ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f4443e-607c-424f-81be-e7f64987210e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
31782024-11-09T02:48:33.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31792024-11-09T02:48:33.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
31802024-11-09T02:48:33.335ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31812024-11-09T02:48:33.336ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73cec6e1-8d2d-4f9e-86bd-31520647b4c2", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
31822024-11-09T02:48:33.336ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31832024-11-09T02:48:33.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31842024-11-09T02:48:33.337ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31852024-11-09T02:48:33.344ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31862024-11-09T02:48:33.344ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
31872024-11-09T02:48:33.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31882024-11-09T02:48:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31892024-11-09T02:48:33.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31902024-11-09T02:48:33.361ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.619172ms iteration = 7 status = {"physical_disks_added":0}
31912024-11-09T02:48:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31922024-11-09T02:48:33.409ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31932024-11-09T02:48:33.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 242.682144ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31942024-11-09T02:48:33.416ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
31952024-11-09T02:48:33.416ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31962024-11-09T02:48:33.416ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8c117d7-4ed7-4bcd-ab6c-555f990b5de3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
31972024-11-09T02:48:33.416ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31982024-11-09T02:48:33.417ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
31992024-11-09T02:48:33.465ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32002024-11-09T02:48:33.468ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32012024-11-09T02:48:33.468ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da5840fa-0fb3-4574-8843-f0f60a01168e", "content-length": "1", "date": "Sat, 09 Nov 2024 02:48:32 GMT"} })
32022024-11-09T02:48:33.470ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32032024-11-09T02:48:33.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32042024-11-09T02:48:33.481ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32052024-11-09T02:48:33.481ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32062024-11-09T02:48:33.481ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79f6b408-3ca9-458d-9ac8-b6077b570b83", "content-length": "372", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32072024-11-09T02:48:33.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32082024-11-09T02:48:33.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32092024-11-09T02:48:33.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32102024-11-09T02:48:33.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32112024-11-09T02:48:33.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32122024-11-09T02:48:33.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32132024-11-09T02:48:33.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32142024-11-09T02:48:33.491ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 324.046386ms iteration = 5 status = null
32152024-11-09T02:48:33.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32162024-11-09T02:48:33.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32172024-11-09T02:48:33.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32182024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
32192024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32202024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
32212024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 329.304244ms iteration = 3 status = {"generation":2}
32222024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
32232024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32242024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
32252024-11-09T02:48:33.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 329.245324ms iteration = 3 status = {"generation":1}
32262024-11-09T02:48:33.500ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32272024-11-09T02:48:33.501ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5e66745e-2eaf-4224-ba19-b829616e2937", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32282024-11-09T02:48:33.501ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32292024-11-09T02:48:33.503ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5edbe6ca-5aea-470f-ac18-8698dc3bb3f3", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32302024-11-09T02:48:33.503ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32312024-11-09T02:48:33.504ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32322024-11-09T02:48:33.504ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 338.001964ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32332024-11-09T02:48:33.510ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32342024-11-09T02:48:33.510ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32352024-11-09T02:48:33.510ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c59e074a-6618-4fcb-8dc6-d4f6fc2841d3", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32362024-11-09T02:48:33.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32372024-11-09T02:48:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32382024-11-09T02:48:33.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32392024-11-09T02:48:33.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32402024-11-09T02:48:33.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32412024-11-09T02:48:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32422024-11-09T02:48:33.519ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32432024-11-09T02:48:33.519ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32442024-11-09T02:48:33.520ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "500aa064-e0c3-443a-82e4-87c3618ac413", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32452024-11-09T02:48:33.521ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 355.074158ms iteration = 5 status = {}
32462024-11-09T02:48:33.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32472024-11-09T02:48:33.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32482024-11-09T02:48:33.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32492024-11-09T02:48:33.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32502024-11-09T02:48:33.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32512024-11-09T02:48:33.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32522024-11-09T02:48:33.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32532024-11-09T02:48:33.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32542024-11-09T02:48:33.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32552024-11-09T02:48:33.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32562024-11-09T02:48:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 394.515472ms iteration = 5 status = {}
32572024-11-09T02:48:33.577ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32582024-11-09T02:48:33.578ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d7e00461-74b5-49ad-8537-bf4234f14cf1", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32592024-11-09T02:48:33.578ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32602024-11-09T02:48:33.580ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a35edf1d-1995-461a-9cbc-144ab453c404", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32612024-11-09T02:48:33.580ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32622024-11-09T02:48:33.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ab752748-9238-46bd-92f0-b33b7163e556", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32632024-11-09T02:48:33.581ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32642024-11-09T02:48:33.583ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32652024-11-09T02:48:33.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 417.481637ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32662024-11-09T02:48:33.620ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32672024-11-09T02:48:33.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32682024-11-09T02:48:33.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32692024-11-09T02:48:33.673ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
32702024-11-09T02:48:33.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32712024-11-09T02:48:33.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32722024-11-09T02:48:33.682ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32732024-11-09T02:48:33.682ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "711b8b43-c901-4c9c-aeaa-70c558f5d474", "content-length": "134", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32742024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32752024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
32762024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32772024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32782024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32792024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32802024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32812024-11-09T02:48:33.682ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32822024-11-09T02:48:33.683ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32832024-11-09T02:48:33.683ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32842024-11-09T02:48:33.683ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
32852024-11-09T02:48:33.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32862024-11-09T02:48:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32872024-11-09T02:48:33.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32882024-11-09T02:48:33.684ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3962f4e0-9c7f-46b5-8fc8-63a1eb912be9", "content-length": "2", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32892024-11-09T02:48:33.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32902024-11-09T02:48:33.684ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f640d52e-2232-4e4f-807f-b9f4aa73d348", "content-length": "52", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32912024-11-09T02:48:33.684ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
32922024-11-09T02:48:33.684ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32932024-11-09T02:48:33.724ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "62ed55ba-2404-4787-91ce-405f976183e6", "content-length": "691", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
32942024-11-09T02:48:33.724ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32952024-11-09T02:48:33.724ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32962024-11-09T02:48:33.724ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32972024-11-09T02:48:33.726ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 559.612815ms iteration = 5 status = {}
32982024-11-09T02:48:33.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce177bfa-73b6-4d5e-98b4-d26adfc5b163 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
32992024-11-09T02:48:33.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce177bfa-73b6-4d5e-98b4-d26adfc5b163 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33002024-11-09T02:48:33.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce177bfa-73b6-4d5e-98b4-d26adfc5b163 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33012024-11-09T02:48:33.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = dce0d9bf-671d-4472-b59b-3addb4d89c1e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
33022024-11-09T02:48:33.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = dce0d9bf-671d-4472-b59b-3addb4d89c1e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
33032024-11-09T02:48:33.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = dce0d9bf-671d-4472-b59b-3addb4d89c1e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
33042024-11-09T02:48:33.898ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a9c6643e-bd51-4b16-8bf7-5dd0630eab41", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
33052024-11-09T02:48:33.899ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
33062024-11-09T02:48:33.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33072024-11-09T02:48:33.899ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7bffdfe-c9ee-423b-8a76-8e865c7244b8", "content-length": "682", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
33082024-11-09T02:48:33.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33092024-11-09T02:48:33.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33102024-11-09T02:48:33.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33112024-11-09T02:48:33.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33122024-11-09T02:48:33.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33132024-11-09T02:48:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33142024-11-09T02:48:33.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33152024-11-09T02:48:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33162024-11-09T02:48:33.913ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 746.832154ms iteration = 5 status = {}
33172024-11-09T02:48:34.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bc386349-d9d4-4be6-8128-c14f7bc1b4ba roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33182024-11-09T02:48:34.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bc386349-d9d4-4be6-8128-c14f7bc1b4ba resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33192024-11-09T02:48:34.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bc386349-d9d4-4be6-8128-c14f7bc1b4ba response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33202024-11-09T02:48:35.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 882ffc64-d9ec-47b0-9794-c9da9d81ab12 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33212024-11-09T02:48:35.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 882ffc64-d9ec-47b0-9794-c9da9d81ab12 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33222024-11-09T02:48:35.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 882ffc64-d9ec-47b0-9794-c9da9d81ab12 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33232024-11-09T02:48:36.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 227b2375-6187-415a-b982-94d59711e306 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33242024-11-09T02:48:36.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 227b2375-6187-415a-b982-94d59711e306 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33252024-11-09T02:48:36.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 227b2375-6187-415a-b982-94d59711e306 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33262024-11-09T02:48:37.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c1754ac5-d935-43d6-ac7d-271bf6e27c2d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33272024-11-09T02:48:37.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c1754ac5-d935-43d6-ac7d-271bf6e27c2d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33282024-11-09T02:48:37.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c1754ac5-d935-43d6-ac7d-271bf6e27c2d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33292024-11-09T02:48:38.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55d0c9ad-d441-4468-b343-1637f3b9f9e8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33302024-11-09T02:48:38.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55d0c9ad-d441-4468-b343-1637f3b9f9e8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33312024-11-09T02:48:38.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55d0c9ad-d441-4468-b343-1637f3b9f9e8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33322024-11-09T02:48:39.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce385560-48d0-425a-b3a3-ba3ffa8b747c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33332024-11-09T02:48:39.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce385560-48d0-425a-b3a3-ba3ffa8b747c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33342024-11-09T02:48:39.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce385560-48d0-425a-b3a3-ba3ffa8b747c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33352024-11-09T02:48:40.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb559936-e882-4242-a969-84fb2c95faeb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33362024-11-09T02:48:40.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb559936-e882-4242-a969-84fb2c95faeb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33372024-11-09T02:48:40.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb559936-e882-4242-a969-84fb2c95faeb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33382024-11-09T02:48:41.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a544f282-50ec-49a7-a9f0-943309f5a353 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33392024-11-09T02:48:41.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a544f282-50ec-49a7-a9f0-943309f5a353 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33402024-11-09T02:48:41.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a544f282-50ec-49a7-a9f0-943309f5a353 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33412024-11-09T02:48:42.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5f9b3de6-0461-4084-b58b-57bf1b59dc5e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33422024-11-09T02:48:42.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5f9b3de6-0461-4084-b58b-57bf1b59dc5e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33432024-11-09T02:48:42.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5f9b3de6-0461-4084-b58b-57bf1b59dc5e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33442024-11-09T02:48:43.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
33452024-11-09T02:48:43.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
33462024-11-09T02:48:43.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33472024-11-09T02:48:43.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33482024-11-09T02:48:43.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33492024-11-09T02:48:43.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33502024-11-09T02:48:43.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33512024-11-09T02:48:43.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33522024-11-09T02:48:43.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33532024-11-09T02:48:43.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.027763ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33542024-11-09T02:48:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33552024-11-09T02:48:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33562024-11-09T02:48:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33572024-11-09T02:48:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33582024-11-09T02:48:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33592024-11-09T02:48:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33602024-11-09T02:48:43.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
33612024-11-09T02:48:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33622024-11-09T02:48:43.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33632024-11-09T02:48:43.187ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
33642024-11-09T02:48:43.187ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.756379ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
33652024-11-09T02:48:43.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1c2c2b53-6996-495e-acee-3f1b9fddb756 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33662024-11-09T02:48:43.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1c2c2b53-6996-495e-acee-3f1b9fddb756 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33672024-11-09T02:48:43.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1c2c2b53-6996-495e-acee-3f1b9fddb756 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33682024-11-09T02:48:44.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ee393367-02fa-48c1-953e-a0ae9771f8a5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33692024-11-09T02:48:44.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ee393367-02fa-48c1-953e-a0ae9771f8a5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33702024-11-09T02:48:44.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ee393367-02fa-48c1-953e-a0ae9771f8a5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33712024-11-09T02:48:45.147ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 725 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c325f1b1-3fff-41e1-82ce-cef757b8b8e2 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
33722024-11-09T02:48:46.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a30e0c68-dec8-4f8b-a50a-0e375647c9af roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33732024-11-09T02:48:46.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a30e0c68-dec8-4f8b-a50a-0e375647c9af resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33742024-11-09T02:48:46.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a30e0c68-dec8-4f8b-a50a-0e375647c9af response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33752024-11-09T02:48:47.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5eb02147-ed03-4d03-9f4d-05cf559e35db roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33762024-11-09T02:48:47.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5eb02147-ed03-4d03-9f4d-05cf559e35db resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33772024-11-09T02:48:47.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5eb02147-ed03-4d03-9f4d-05cf559e35db response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33782024-11-09T02:48:48.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1fd3ace-877f-47c5-a358-a92d59afd3a5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33792024-11-09T02:48:48.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1fd3ace-877f-47c5-a358-a92d59afd3a5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33802024-11-09T02:48:48.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1fd3ace-877f-47c5-a358-a92d59afd3a5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33812024-11-09T02:48:49.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 903da4af-6387-4cd7-a80f-e7e2f3a9bb71 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33822024-11-09T02:48:49.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 903da4af-6387-4cd7-a80f-e7e2f3a9bb71 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33832024-11-09T02:48:49.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 903da4af-6387-4cd7-a80f-e7e2f3a9bb71 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33842024-11-09T02:48:50.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6cb8ad2e-c216-4394-94a2-495f468bf279 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33852024-11-09T02:48:50.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6cb8ad2e-c216-4394-94a2-495f468bf279 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33862024-11-09T02:48:50.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6cb8ad2e-c216-4394-94a2-495f468bf279 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33872024-11-09T02:48:51.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e42e299-d11d-4e94-8e1f-d38f5f9ae8bc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33882024-11-09T02:48:51.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e42e299-d11d-4e94-8e1f-d38f5f9ae8bc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33892024-11-09T02:48:51.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e42e299-d11d-4e94-8e1f-d38f5f9ae8bc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33902024-11-09T02:48:52.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 684c1a32-10e0-483a-8a29-bcd9d1e3f637 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33912024-11-09T02:48:52.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 684c1a32-10e0-483a-8a29-bcd9d1e3f637 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33922024-11-09T02:48:52.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 684c1a32-10e0-483a-8a29-bcd9d1e3f637 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33932024-11-09T02:48:53.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d5038ac-d42b-4bbd-89ff-d9be1650e6fb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33942024-11-09T02:48:53.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d5038ac-d42b-4bbd-89ff-d9be1650e6fb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33952024-11-09T02:48:53.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d5038ac-d42b-4bbd-89ff-d9be1650e6fb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
33962024-11-09T02:48:53.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
33972024-11-09T02:48:53.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
33982024-11-09T02:48:53.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33992024-11-09T02:48:53.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34002024-11-09T02:48:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34012024-11-09T02:48:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34022024-11-09T02:48:53.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34032024-11-09T02:48:53.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34042024-11-09T02:48:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34052024-11-09T02:48:53.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.945921ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34062024-11-09T02:48:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34072024-11-09T02:48:53.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34082024-11-09T02:48:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34092024-11-09T02:48:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34102024-11-09T02:48:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34112024-11-09T02:48:53.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34122024-11-09T02:48:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
34132024-11-09T02:48:53.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34142024-11-09T02:48:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34152024-11-09T02:48:53.185ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
34162024-11-09T02:48:53.185ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.219947ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
34172024-11-09T02:48:54.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e3a30914-2be0-437e-8382-dfca29899922 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34182024-11-09T02:48:54.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e3a30914-2be0-437e-8382-dfca29899922 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34192024-11-09T02:48:54.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e3a30914-2be0-437e-8382-dfca29899922 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34202024-11-09T02:48:55.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7629ddc7-f5cb-4898-b657-8163a6e261c5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34212024-11-09T02:48:55.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7629ddc7-f5cb-4898-b657-8163a6e261c5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34222024-11-09T02:48:55.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7629ddc7-f5cb-4898-b657-8163a6e261c5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34232024-11-09T02:48:56.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91c56e04-5a1b-4500-9d26-141dde10b0c9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34242024-11-09T02:48:56.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91c56e04-5a1b-4500-9d26-141dde10b0c9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34252024-11-09T02:48:56.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91c56e04-5a1b-4500-9d26-141dde10b0c9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34262024-11-09T02:48:57.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dec3a0d8-a0f5-4898-bdc7-bf3996f37276 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34272024-11-09T02:48:57.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dec3a0d8-a0f5-4898-bdc7-bf3996f37276 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34282024-11-09T02:48:57.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dec3a0d8-a0f5-4898-bdc7-bf3996f37276 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34292024-11-09T02:48:58.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2ff93472-8350-4e08-b74f-976dcb8c6608 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34302024-11-09T02:48:58.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2ff93472-8350-4e08-b74f-976dcb8c6608 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34312024-11-09T02:48:58.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2ff93472-8350-4e08-b74f-976dcb8c6608 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34322024-11-09T02:48:59.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa991fed-3513-4cf2-a7f0-3840c91944b6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34332024-11-09T02:48:59.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa991fed-3513-4cf2-a7f0-3840c91944b6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34342024-11-09T02:48:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa991fed-3513-4cf2-a7f0-3840c91944b6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34352024-11-09T02:49:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 489 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = d9d6733e-4e7b-4da9-a90a-f27c609dfdc0 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
34362024-11-09T02:49:00.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 913bef49-eaf7-4ed8-ac0b-a82eddb35ad8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34372024-11-09T02:49:00.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 913bef49-eaf7-4ed8-ac0b-a82eddb35ad8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34382024-11-09T02:49:00.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 913bef49-eaf7-4ed8-ac0b-a82eddb35ad8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34392024-11-09T02:49:01.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d88fda1-1634-4768-b146-f39d9534c910 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34402024-11-09T02:49:01.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d88fda1-1634-4768-b146-f39d9534c910 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34412024-11-09T02:49:01.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d88fda1-1634-4768-b146-f39d9534c910 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34422024-11-09T02:49:02.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7438466-70d8-4d1a-874d-a7a73c1e460d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34432024-11-09T02:49:02.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7438466-70d8-4d1a-874d-a7a73c1e460d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34442024-11-09T02:49:02.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7438466-70d8-4d1a-874d-a7a73c1e460d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
34452024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
34462024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
34472024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34482024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34492024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
34502024-11-09T02:49:03.166ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34512024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
34522024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34532024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34542024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
34552024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34562024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
34572024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
34582024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34592024-11-09T02:49:03.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34602024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
34612024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34622024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34632024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
34642024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34652024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
34662024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
34672024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34682024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34692024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
34702024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34712024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
34722024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34732024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34742024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34752024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34762024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34772024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34782024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34792024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34802024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34812024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34822024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34832024-11-09T02:49:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34842024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
34852024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
34862024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.441\u{b5}s iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34872024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
34882024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.131\u{b5}s iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34892024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
34902024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.87\u{b5}s iteration = 6 status = {"errors":[],"records_set_to_done":[]}
34912024-11-09T02:49:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.39\u{b5}s iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
34922024-11-09T02:49:03.169ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34932024-11-09T02:49:03.169ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34942024-11-09T02:49:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34952024-11-09T02:49:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34962024-11-09T02:49:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34972024-11-09T02:49:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34982024-11-09T02:49:03.170ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1046, tv_nsec: 510767004 } })
34992024-11-09T02:49:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.992332ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35002024-11-09T02:49:03.171ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1046, tv_nsec: 510987239 } })
35012024-11-09T02:49:03.171ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
35022024-11-09T02:49:03.171ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
35032024-11-09T02:49:03.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35042024-11-09T02:49:03.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35052024-11-09T02:49:03.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062024-11-09T02:49:03.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35072024-11-09T02:49:03.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35082024-11-09T02:49:03.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35092024-11-09T02:49:03.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35102024-11-09T02:49:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35112024-11-09T02:49:03.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35122024-11-09T02:49:03.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35132024-11-09T02:49:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35142024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35152024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35162024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35172024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35182024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35192024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35202024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35212024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35222024-11-09T02:49:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35232024-11-09T02:49:03.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.995598ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35242024-11-09T02:49:03.180ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35252024-11-09T02:49:03.180ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35262024-11-09T02:49:03.180ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35272024-11-09T02:49:03.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35282024-11-09T02:49:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35292024-11-09T02:49:03.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35302024-11-09T02:49:03.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35312024-11-09T02:49:03.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35322024-11-09T02:49:03.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35332024-11-09T02:49:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35342024-11-09T02:49:03.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35352024-11-09T02:49:03.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35362024-11-09T02:49:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35372024-11-09T02:49:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35382024-11-09T02:49:03.186ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35392024-11-09T02:49:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35402024-11-09T02:49:03.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1046, tv_nsec: 527755055 } })
35412024-11-09T02:49:03.188ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
35422024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35432024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35442024-11-09T02:49:03.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35452024-11-09T02:49:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35462024-11-09T02:49:03.216ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35472024-11-09T02:49:03.216ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35482024-11-09T02:49:03.216ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 49.306049ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35492024-11-09T02:49:03.217ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35502024-11-09T02:49:03.217ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.667617ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35512024-11-09T02:49:03.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35522024-11-09T02:49:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35532024-11-09T02:49:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35542024-11-09T02:49:03.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35552024-11-09T02:49:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35562024-11-09T02:49:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35572024-11-09T02:49:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35582024-11-09T02:49:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
35592024-11-09T02:49:03.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35602024-11-09T02:49:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35612024-11-09T02:49:03.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35622024-11-09T02:49:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35632024-11-09T02:49:03.225ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.409047ms iteration = 6 status = 0
35642024-11-09T02:49:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652024-11-09T02:49:03.227ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 60.95305ms iteration = 8 status = {"physical_disks_added":0}
35662024-11-09T02:49:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
35672024-11-09T02:49:03.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35682024-11-09T02:49:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35692024-11-09T02:49:03.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
35702024-11-09T02:49:03.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.906616ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
35712024-11-09T02:49:03.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.083124ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35722024-11-09T02:49:03.246ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
35732024-11-09T02:49:03.246ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35742024-11-09T02:49:03.247ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95c40398-96f4-4c62-923d-d3c962c268b8", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
35752024-11-09T02:49:03.247ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35762024-11-09T02:49:03.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35772024-11-09T02:49:03.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
35782024-11-09T02:49:03.264ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35792024-11-09T02:49:03.264ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff20ad02-5fb9-409a-a998-d3a84fd7ca5b", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
35802024-11-09T02:49:03.264ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35812024-11-09T02:49:03.265ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35822024-11-09T02:49:03.279ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
35832024-11-09T02:49:03.279ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35842024-11-09T02:49:03.279ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7186a36-5d53-42ac-9073-0bc93f0aa4f0", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
35852024-11-09T02:49:03.279ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35862024-11-09T02:49:03.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
35872024-11-09T02:49:03.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35882024-11-09T02:49:03.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35892024-11-09T02:49:03.368ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.113387ms iteration = 6 status = {}
35902024-11-09T02:49:03.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4bc9f75a-782e-45d1-bbf9-94bd4c8c3282 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
35912024-11-09T02:49:03.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4bc9f75a-782e-45d1-bbf9-94bd4c8c3282 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
35922024-11-09T02:49:03.380ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35932024-11-09T02:49:03.380ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35942024-11-09T02:49:03.380ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb4aa734-3d71-4b7f-96b3-2a71377cad45", "content-length": "372", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
35952024-11-09T02:49:03.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35962024-11-09T02:49:03.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35972024-11-09T02:49:03.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4bc9f75a-782e-45d1-bbf9-94bd4c8c3282 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
35982024-11-09T02:49:03.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35992024-11-09T02:49:03.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36002024-11-09T02:49:03.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36012024-11-09T02:49:03.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36022024-11-09T02:49:03.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36032024-11-09T02:49:03.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36042024-11-09T02:49:03.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36052024-11-09T02:49:03.394ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36062024-11-09T02:49:03.395ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e8716f42-ede7-4c8b-951b-4b5f71b0b5cb", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36072024-11-09T02:49:03.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36082024-11-09T02:49:03.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36092024-11-09T02:49:03.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102024-11-09T02:49:03.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36112024-11-09T02:49:03.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36122024-11-09T02:49:03.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36132024-11-09T02:49:03.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36142024-11-09T02:49:03.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36152024-11-09T02:49:03.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36162024-11-09T02:49:03.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36172024-11-09T02:49:03.403ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36182024-11-09T02:49:03.403ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36192024-11-09T02:49:03.403ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0f8ec32c-b381-4bf0-88cb-16aa777a96ec", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36202024-11-09T02:49:03.405ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 238.303065ms iteration = 6 status = {}
36212024-11-09T02:49:03.477ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36222024-11-09T02:49:03.477ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac008a4d-c0b9-4c41-87c6-5d74d85b39f0", "content-length": "1", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36232024-11-09T02:49:03.479ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36242024-11-09T02:49:03.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36252024-11-09T02:49:03.481ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.445238ms iteration = 6 status = null
36262024-11-09T02:49:03.491ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36272024-11-09T02:49:03.511ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c95e2b84-d43c-4570-9041-c19b3ac9d39e", "content-length": "691", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36282024-11-09T02:49:03.512ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
36292024-11-09T02:49:03.512ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
36302024-11-09T02:49:03.512ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
36312024-11-09T02:49:03.514ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.259767ms iteration = 6 status = {}
36322024-11-09T02:49:03.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36332024-11-09T02:49:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36342024-11-09T02:49:03.549ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
36352024-11-09T02:49:03.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36362024-11-09T02:49:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36372024-11-09T02:49:03.559ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36382024-11-09T02:49:03.559ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c9e0d03-4488-421c-be3d-a5b305094081", "content-length": "134", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36392024-11-09T02:49:03.559ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36402024-11-09T02:49:03.559ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
36412024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36422024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36432024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36442024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36452024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36462024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36472024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36482024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36492024-11-09T02:49:03.560ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
36502024-11-09T02:49:03.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36512024-11-09T02:49:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36522024-11-09T02:49:03.562ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36532024-11-09T02:49:03.562ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "57bfd6d5-536f-4b53-a879-b6855a81bc1e", "content-length": "2", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36542024-11-09T02:49:03.562ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36552024-11-09T02:49:03.562ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8a6a937-765f-45c1-8fbd-458ab6ac879d", "content-length": "52", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36562024-11-09T02:49:03.562ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
36572024-11-09T02:49:03.563ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36582024-11-09T02:49:03.696ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e24b7fef-2ce1-41c9-8bac-3bcbe76f2a28", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36592024-11-09T02:49:03.696ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
36602024-11-09T02:49:03.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36612024-11-09T02:49:03.696ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d364e7a2-65f5-4793-9f1f-e6b62960edbe", "content-length": "682", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
36622024-11-09T02:49:03.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36632024-11-09T02:49:03.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36642024-11-09T02:49:03.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36652024-11-09T02:49:03.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36662024-11-09T02:49:03.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36672024-11-09T02:49:03.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36682024-11-09T02:49:03.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36692024-11-09T02:49:03.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36702024-11-09T02:49:03.713ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 546.643667ms iteration = 6 status = {}
36712024-11-09T02:49:03.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 9692be38-854c-4fa8-b056-f1884ff863e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36722024-11-09T02:49:03.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 9692be38-854c-4fa8-b056-f1884ff863e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36732024-11-09T02:49:03.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 9692be38-854c-4fa8-b056-f1884ff863e6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36742024-11-09T02:49:04.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d511422f-098e-4b87-a022-0cb2c200cc53 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36752024-11-09T02:49:04.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d511422f-098e-4b87-a022-0cb2c200cc53 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36762024-11-09T02:49:04.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d511422f-098e-4b87-a022-0cb2c200cc53 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36772024-11-09T02:49:05.141ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:61771
36782024-11-09T02:49:05.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = b0c3f814-29b6-469f-93e1-ed210e830393 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
36792024-11-09T02:49:05.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = b0c3f814-29b6-469f-93e1-ed210e830393 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
36802024-11-09T02:49:05.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = b0c3f814-29b6-469f-93e1-ed210e830393 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
36812024-11-09T02:49:05.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 3e6b103a-5384-4456-a0fe-d2776d24bfcf roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
36822024-11-09T02:49:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 3e6b103a-5384-4456-a0fe-d2776d24bfcf resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
36832024-11-09T02:49:05.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 3e6b103a-5384-4456-a0fe-d2776d24bfcf response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
36842024-11-09T02:49:05.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a07d5615-2608-4004-a017-146c8247faf3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36852024-11-09T02:49:05.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a07d5615-2608-4004-a017-146c8247faf3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36862024-11-09T02:49:05.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a07d5615-2608-4004-a017-146c8247faf3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36872024-11-09T02:49:06.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 701dea2e-cc4f-497b-aa25-35db484c77af roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36882024-11-09T02:49:06.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 701dea2e-cc4f-497b-aa25-35db484c77af resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36892024-11-09T02:49:06.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 701dea2e-cc4f-497b-aa25-35db484c77af response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36902024-11-09T02:49:07.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7653aafd-9ac0-414f-bb48-df679bff72bb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36912024-11-09T02:49:07.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7653aafd-9ac0-414f-bb48-df679bff72bb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36922024-11-09T02:49:07.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7653aafd-9ac0-414f-bb48-df679bff72bb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36932024-11-09T02:49:08.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 740c2b5e-c50c-4e8b-a10b-b51ea5ac0dbd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36942024-11-09T02:49:08.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 740c2b5e-c50c-4e8b-a10b-b51ea5ac0dbd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36952024-11-09T02:49:08.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 740c2b5e-c50c-4e8b-a10b-b51ea5ac0dbd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36962024-11-09T02:49:09.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43cb800b-7d8b-4c91-a0d1-58d62316633c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36972024-11-09T02:49:09.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43cb800b-7d8b-4c91-a0d1-58d62316633c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36982024-11-09T02:49:09.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43cb800b-7d8b-4c91-a0d1-58d62316633c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
36992024-11-09T02:49:10.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84413fd2-80ed-43ba-8958-1dbb3ca2a4df roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37002024-11-09T02:49:10.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84413fd2-80ed-43ba-8958-1dbb3ca2a4df resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37012024-11-09T02:49:10.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84413fd2-80ed-43ba-8958-1dbb3ca2a4df response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37022024-11-09T02:49:11.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db88a6c6-50aa-4b7e-82ba-aa016aca1f17 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37032024-11-09T02:49:11.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db88a6c6-50aa-4b7e-82ba-aa016aca1f17 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37042024-11-09T02:49:11.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db88a6c6-50aa-4b7e-82ba-aa016aca1f17 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37052024-11-09T02:49:12.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2cd0c114-5f84-4f13-9f71-88f6c0560253 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37062024-11-09T02:49:12.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2cd0c114-5f84-4f13-9f71-88f6c0560253 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37072024-11-09T02:49:12.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2cd0c114-5f84-4f13-9f71-88f6c0560253 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37082024-11-09T02:49:13.166ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
37092024-11-09T02:49:13.166ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
37102024-11-09T02:49:13.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37112024-11-09T02:49:13.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37122024-11-09T02:49:13.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37132024-11-09T02:49:13.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37142024-11-09T02:49:13.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37152024-11-09T02:49:13.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37162024-11-09T02:49:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37172024-11-09T02:49:13.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.043293ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37182024-11-09T02:49:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37192024-11-09T02:49:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37202024-11-09T02:49:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37212024-11-09T02:49:13.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-11-09T02:49:13.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-11-09T02:49:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-11-09T02:49:13.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
37252024-11-09T02:49:13.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37262024-11-09T02:49:13.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37272024-11-09T02:49:13.188ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
37282024-11-09T02:49:13.188ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.655248ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
37292024-11-09T02:49:13.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a27289c9-4682-49a4-bdc0-eb1160739651 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37302024-11-09T02:49:13.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a27289c9-4682-49a4-bdc0-eb1160739651 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37312024-11-09T02:49:13.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a27289c9-4682-49a4-bdc0-eb1160739651 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37322024-11-09T02:49:14.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eabc1a35-5715-42ba-b2e7-862fe1bce15c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37332024-11-09T02:49:14.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eabc1a35-5715-42ba-b2e7-862fe1bce15c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37342024-11-09T02:49:14.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eabc1a35-5715-42ba-b2e7-862fe1bce15c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37352024-11-09T02:49:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 842 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 9205869d-2515-4639-ab23-588db2a9483a response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
37362024-11-09T02:49:15.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2cc248d6-5490-4df7-a1c7-bb2e5a295bd4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37372024-11-09T02:49:15.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2cc248d6-5490-4df7-a1c7-bb2e5a295bd4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37382024-11-09T02:49:15.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2cc248d6-5490-4df7-a1c7-bb2e5a295bd4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37392024-11-09T02:49:16.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5148cf6-c57d-4889-9275-1ce8c2ab75c1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37402024-11-09T02:49:16.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5148cf6-c57d-4889-9275-1ce8c2ab75c1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37412024-11-09T02:49:16.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5148cf6-c57d-4889-9275-1ce8c2ab75c1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37422024-11-09T02:49:17.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 66ade1f8-eba8-4146-b6a7-04f94fd128d1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37432024-11-09T02:49:17.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 66ade1f8-eba8-4146-b6a7-04f94fd128d1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37442024-11-09T02:49:17.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 66ade1f8-eba8-4146-b6a7-04f94fd128d1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37452024-11-09T02:49:18.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f51567bc-86b6-4546-84dc-d4fa769da0a8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37462024-11-09T02:49:18.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f51567bc-86b6-4546-84dc-d4fa769da0a8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37472024-11-09T02:49:18.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f51567bc-86b6-4546-84dc-d4fa769da0a8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37482024-11-09T02:49:19.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2ca9616-f496-488a-910d-54890957b699 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37492024-11-09T02:49:19.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2ca9616-f496-488a-910d-54890957b699 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37502024-11-09T02:49:19.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2ca9616-f496-488a-910d-54890957b699 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37512024-11-09T02:49:20.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a749e12c-f020-44de-99f8-022ff6c69bb8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37522024-11-09T02:49:20.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a749e12c-f020-44de-99f8-022ff6c69bb8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37532024-11-09T02:49:20.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a749e12c-f020-44de-99f8-022ff6c69bb8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37542024-11-09T02:49:21.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 71a0304d-9e66-4570-9e1d-f0b0936dc536 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37552024-11-09T02:49:21.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 71a0304d-9e66-4570-9e1d-f0b0936dc536 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37562024-11-09T02:49:21.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 71a0304d-9e66-4570-9e1d-f0b0936dc536 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37572024-11-09T02:49:22.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb2170aa-b257-4033-b24e-86822461228b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37582024-11-09T02:49:22.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb2170aa-b257-4033-b24e-86822461228b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37592024-11-09T02:49:22.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb2170aa-b257-4033-b24e-86822461228b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37602024-11-09T02:49:23.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
37612024-11-09T02:49:23.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37622024-11-09T02:49:23.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
37632024-11-09T02:49:23.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37642024-11-09T02:49:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37652024-11-09T02:49:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37662024-11-09T02:49:23.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37672024-11-09T02:49:23.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37682024-11-09T02:49:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37692024-11-09T02:49:23.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.825269ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37702024-11-09T02:49:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37712024-11-09T02:49:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37722024-11-09T02:49:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37732024-11-09T02:49:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37742024-11-09T02:49:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37752024-11-09T02:49:23.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762024-11-09T02:49:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
37772024-11-09T02:49:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37782024-11-09T02:49:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37792024-11-09T02:49:23.184ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
37802024-11-09T02:49:23.184ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.509422ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
37812024-11-09T02:49:23.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76460beb-65de-4da3-8299-0ddd0fd2ac0e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37822024-11-09T02:49:23.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76460beb-65de-4da3-8299-0ddd0fd2ac0e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37832024-11-09T02:49:23.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76460beb-65de-4da3-8299-0ddd0fd2ac0e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37842024-11-09T02:49:24.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4c41eec-eaf6-48cb-bb4e-52579b16fa07 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37852024-11-09T02:49:24.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4c41eec-eaf6-48cb-bb4e-52579b16fa07 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37862024-11-09T02:49:24.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4c41eec-eaf6-48cb-bb4e-52579b16fa07 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37872024-11-09T02:49:25.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9be3927-a452-4993-ab25-fc98f4de8512 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37882024-11-09T02:49:25.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9be3927-a452-4993-ab25-fc98f4de8512 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37892024-11-09T02:49:25.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9be3927-a452-4993-ab25-fc98f4de8512 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37902024-11-09T02:49:26.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff582cb5-005b-4361-9f1e-b5e4346b8a15 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37912024-11-09T02:49:26.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff582cb5-005b-4361-9f1e-b5e4346b8a15 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37922024-11-09T02:49:26.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff582cb5-005b-4361-9f1e-b5e4346b8a15 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37932024-11-09T02:49:27.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1cfb3011-5478-45c7-945b-3091426b3e46 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37942024-11-09T02:49:27.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1cfb3011-5478-45c7-945b-3091426b3e46 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37952024-11-09T02:49:27.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1cfb3011-5478-45c7-945b-3091426b3e46 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37962024-11-09T02:49:28.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a3d0e6f4-4930-4bfb-aa30-1b97c5efa0b7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37972024-11-09T02:49:28.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a3d0e6f4-4930-4bfb-aa30-1b97c5efa0b7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37982024-11-09T02:49:28.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a3d0e6f4-4930-4bfb-aa30-1b97c5efa0b7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
37992024-11-09T02:49:29.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8b9d4864-5582-4468-b71c-3ed5cc704331 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38002024-11-09T02:49:29.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8b9d4864-5582-4468-b71c-3ed5cc704331 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38012024-11-09T02:49:29.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8b9d4864-5582-4468-b71c-3ed5cc704331 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38022024-11-09T02:49:30.147ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 480 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c506fe97-1fb3-44f3-ad9e-55310fecb4da response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
38032024-11-09T02:49:30.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 92b1eebb-dfbe-45e3-9296-9acb3c99eb74 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38042024-11-09T02:49:30.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 92b1eebb-dfbe-45e3-9296-9acb3c99eb74 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38052024-11-09T02:49:30.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 92b1eebb-dfbe-45e3-9296-9acb3c99eb74 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38062024-11-09T02:49:31.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ecb1aae-88d2-4dc0-9721-43a3da71a4ea roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38072024-11-09T02:49:31.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ecb1aae-88d2-4dc0-9721-43a3da71a4ea resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38082024-11-09T02:49:31.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ecb1aae-88d2-4dc0-9721-43a3da71a4ea response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38092024-11-09T02:49:33.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 73a5cd80-10fd-44f3-a22f-951019a12f74 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38102024-11-09T02:49:33.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 73a5cd80-10fd-44f3-a22f-951019a12f74 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38112024-11-09T02:49:33.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 73a5cd80-10fd-44f3-a22f-951019a12f74 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
38122024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
38132024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38142024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
38152024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38162024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38172024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
38182024-11-09T02:49:33.166ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38192024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
38202024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38212024-11-09T02:49:33.166ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
38222024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38232024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38242024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
38252024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
38262024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
38272024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38282024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38292024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
38302024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38312024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
38322024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
38332024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38342024-11-09T02:49:33.167ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:39:33.167431667 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38352024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38362024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
38372024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
38382024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38392024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38402024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38412024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
38422024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38432024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
38442024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
38452024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38462024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38472024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38482024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
38492024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
38502024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38512024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38522024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38532024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
38542024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
38552024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38562024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
38572024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38582024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
38592024-11-09T02:49:33.167ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
38602024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38612024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
38622024-11-09T02:49:33.167ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38632024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.67\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
38642024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38652024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38662024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
38672024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38682024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38692024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
38702024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38712024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
38722024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.95\u{b5}s iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38732024-11-09T02:49:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
38742024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.73\u{b5}s iteration = 7 status = {"errors":[],"records_set_to_done":[]}
38752024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
38762024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38772024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38782024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
38792024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38802024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38812024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
38822024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38832024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.8\u{b5}s iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38842024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
38852024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.59\u{b5}s iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
38862024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38872024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38882024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38892024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38902024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38912024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38922024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38932024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38942024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38952024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38962024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38972024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38982024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38992024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39002024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39012024-11-09T02:49:33.168ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 508050448 } })
39022024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39032024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39042024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39052024-11-09T02:49:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39062024-11-09T02:49:33.169ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39072024-11-09T02:49:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.576093ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39082024-11-09T02:49:33.169ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 509209172 } })
39092024-11-09T02:49:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39102024-11-09T02:49:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.534293ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39112024-11-09T02:49:33.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39122024-11-09T02:49:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39132024-11-09T02:49:33.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39142024-11-09T02:49:33.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39152024-11-09T02:49:33.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39162024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39172024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39182024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39192024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39202024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39212024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39222024-11-09T02:49:33.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.391505ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39232024-11-09T02:49:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39242024-11-09T02:49:33.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39252024-11-09T02:49:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39262024-11-09T02:49:33.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39272024-11-09T02:49:33.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 521900914 } })
39282024-11-09T02:49:33.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-11-09T02:49:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39302024-11-09T02:49:33.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
39312024-11-09T02:49:33.182ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:39:33.167431667 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39322024-11-09T02:49:33.182ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.340617ms iteration = 4 status = {"expiration":"2024-11-09T02:39:33.167431667Z","pruned":[]}
39332024-11-09T02:49:33.182ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39342024-11-09T02:49:33.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39352024-11-09T02:49:33.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39362024-11-09T02:49:33.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39372024-11-09T02:49:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39382024-11-09T02:49:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39392024-11-09T02:49:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39402024-11-09T02:49:33.186ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39412024-11-09T02:49:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39422024-11-09T02:49:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39432024-11-09T02:49:33.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39442024-11-09T02:49:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39452024-11-09T02:49:33.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39462024-11-09T02:49:33.187ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39472024-11-09T02:49:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39482024-11-09T02:49:33.188ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39492024-11-09T02:49:33.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39502024-11-09T02:49:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39512024-11-09T02:49:33.191ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39522024-11-09T02:49:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39532024-11-09T02:49:33.191ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39542024-11-09T02:49:33.191ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39552024-11-09T02:49:33.191ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39562024-11-09T02:49:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39572024-11-09T02:49:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39582024-11-09T02:49:33.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39592024-11-09T02:49:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39602024-11-09T02:49:33.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39612024-11-09T02:49:33.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39622024-11-09T02:49:33.196ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 536094027 } })
39632024-11-09T02:49:33.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39642024-11-09T02:49:33.196ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
39652024-11-09T02:49:33.197ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.422878ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
39662024-11-09T02:49:33.198ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39672024-11-09T02:49:33.198ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39682024-11-09T02:49:33.198ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 31.131674ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39692024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39702024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39712024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39722024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39732024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39742024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39752024-11-09T02:49:33.199ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39762024-11-09T02:49:33.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39772024-11-09T02:49:33.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39782024-11-09T02:49:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39792024-11-09T02:49:33.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39802024-11-09T02:49:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39812024-11-09T02:49:33.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39822024-11-09T02:49:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39832024-11-09T02:49:33.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842024-11-09T02:49:33.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39852024-11-09T02:49:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39862024-11-09T02:49:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39872024-11-09T02:49:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39882024-11-09T02:49:33.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39892024-11-09T02:49:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39902024-11-09T02:49:33.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39912024-11-09T02:49:33.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39922024-11-09T02:49:33.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39932024-11-09T02:49:33.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.954797ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39942024-11-09T02:49:33.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39952024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39962024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39972024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39982024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39992024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40002024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40012024-11-09T02:49:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40022024-11-09T02:49:33.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40032024-11-09T02:49:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40042024-11-09T02:49:33.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 558710725 } })
40052024-11-09T02:49:33.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
40062024-11-09T02:49:33.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40072024-11-09T02:49:33.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40082024-11-09T02:49:33.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40092024-11-09T02:49:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40102024-11-09T02:49:33.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40112024-11-09T02:49:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40122024-11-09T02:49:33.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40132024-11-09T02:49:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40142024-11-09T02:49:33.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152024-11-09T02:49:33.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-11-09T02:49:33.228ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172024-11-09T02:49:33.229ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 62.084923ms iteration = 3 status = {"nsuccess":5}
40182024-11-09T02:49:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40192024-11-09T02:49:33.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40202024-11-09T02:49:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40212024-11-09T02:49:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
40222024-11-09T02:49:33.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40232024-11-09T02:49:33.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40242024-11-09T02:49:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40252024-11-09T02:49:33.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40262024-11-09T02:49:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40272024-11-09T02:49:33.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40282024-11-09T02:49:33.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40292024-11-09T02:49:33.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40302024-11-09T02:49:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40312024-11-09T02:49:33.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322024-11-09T02:49:33.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40332024-11-09T02:49:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40342024-11-09T02:49:33.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40352024-11-09T02:49:33.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40362024-11-09T02:49:33.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40372024-11-09T02:49:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40382024-11-09T02:49:33.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40392024-11-09T02:49:33.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40402024-11-09T02:49:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40412024-11-09T02:49:33.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
40422024-11-09T02:49:33.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.142133ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
40432024-11-09T02:49:33.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40442024-11-09T02:49:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40452024-11-09T02:49:33.263ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40462024-11-09T02:49:33.263ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40472024-11-09T02:49:33.263ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40482024-11-09T02:49:33.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40492024-11-09T02:49:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40502024-11-09T02:49:33.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40512024-11-09T02:49:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40522024-11-09T02:49:33.268ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40532024-11-09T02:49:33.268ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40542024-11-09T02:49:33.268ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40552024-11-09T02:49:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40562024-11-09T02:49:33.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40572024-11-09T02:49:33.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.887729ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40582024-11-09T02:49:33.273ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40592024-11-09T02:49:33.274ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.359648ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40602024-11-09T02:49:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40612024-11-09T02:49:33.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40622024-11-09T02:49:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40632024-11-09T02:49:33.274ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40642024-11-09T02:49:33.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40652024-11-09T02:49:33.276ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40662024-11-09T02:49:33.277ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40672024-11-09T02:49:33.277ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40682024-11-09T02:49:33.277ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.573134ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40692024-11-09T02:49:33.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40702024-11-09T02:49:33.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40712024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40722024-11-09T02:49:33.281ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40732024-11-09T02:49:33.281ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40742024-11-09T02:49:33.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40752024-11-09T02:49:33.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40762024-11-09T02:49:33.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40772024-11-09T02:49:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40782024-11-09T02:49:33.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
40792024-11-09T02:49:33.321ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40802024-11-09T02:49:33.321ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18469f5c-90aa-4421-aefe-1e511759952a", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
40812024-11-09T02:49:33.321ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40822024-11-09T02:49:33.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40832024-11-09T02:49:33.340ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
40842024-11-09T02:49:33.340ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 172.600047ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40852024-11-09T02:49:33.357ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.791384ms iteration = 9 status = {"physical_disks_added":0}
40862024-11-09T02:49:33.387ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
40872024-11-09T02:49:33.387ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40882024-11-09T02:49:33.388ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b11bd3a5-5560-4a71-85bc-a4024a799b97", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
40892024-11-09T02:49:33.388ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40902024-11-09T02:49:33.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40912024-11-09T02:49:33.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
40922024-11-09T02:49:33.393ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40932024-11-09T02:49:33.394ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1733d971-e371-4a4a-8dee-a59a982f8566", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
40942024-11-09T02:49:33.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40952024-11-09T02:49:33.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
40962024-11-09T02:49:33.405ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40972024-11-09T02:49:33.405ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "371fa588-f399-45d1-a0a1-66f960b5e6fd", "content-length": "691", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
40982024-11-09T02:49:33.405ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
40992024-11-09T02:49:33.405ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41002024-11-09T02:49:33.405ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41012024-11-09T02:49:33.407ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 240.451728ms iteration = 7 status = {}
41022024-11-09T02:49:33.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032024-11-09T02:49:33.409ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41042024-11-09T02:49:33.409ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
41052024-11-09T02:49:33.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41062024-11-09T02:49:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41072024-11-09T02:49:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
41082024-11-09T02:49:33.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41092024-11-09T02:49:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41102024-11-09T02:49:33.417ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 250.554927ms iteration = 7 status = 0
41112024-11-09T02:49:33.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-11-09T02:49:33.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41132024-11-09T02:49:33.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41142024-11-09T02:49:33.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41152024-11-09T02:49:33.425ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
41162024-11-09T02:49:33.425ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41172024-11-09T02:49:33.425ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
41182024-11-09T02:49:33.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 258.742417ms iteration = 4 status = {"generation":2}
41192024-11-09T02:49:33.442ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41202024-11-09T02:49:33.442ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41212024-11-09T02:49:33.442ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 274.751917ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41222024-11-09T02:49:33.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41232024-11-09T02:49:33.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41242024-11-09T02:49:33.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41252024-11-09T02:49:33.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41262024-11-09T02:49:33.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41272024-11-09T02:49:33.458ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41282024-11-09T02:49:33.458ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41292024-11-09T02:49:33.458ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
41302024-11-09T02:49:33.458ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 290.785369ms iteration = 4 status = {"generation":1}
41312024-11-09T02:49:33.458ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "754a46b8-55f2-4f17-b5fa-c08f4d45e99e", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41322024-11-09T02:49:33.458ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41332024-11-09T02:49:33.459ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f8f1cf1f-1f23-4fcd-bc25-31df6dc8a5e5", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41342024-11-09T02:49:33.459ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41352024-11-09T02:49:33.461ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41362024-11-09T02:49:33.461ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 294.925845ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41372024-11-09T02:49:33.464ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41382024-11-09T02:49:33.484ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
41392024-11-09T02:49:33.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 317.340078ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
41402024-11-09T02:49:33.490ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.568217ms iteration = 7 status = {}
41412024-11-09T02:49:33.562ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41422024-11-09T02:49:33.562ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d428653-0ab8-44d4-ae74-b53a6d52e689", "content-length": "1", "date": "Sat, 09 Nov 2024 02:49:32 GMT"} })
41432024-11-09T02:49:33.563ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41442024-11-09T02:49:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41452024-11-09T02:49:33.580ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41462024-11-09T02:49:33.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "336300f9-8a50-41bb-95f3-83896e302304", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41472024-11-09T02:49:33.581ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41482024-11-09T02:49:33.583ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6b7f1227-cb17-45ac-990c-d7dee6258f5b", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41492024-11-09T02:49:33.583ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41502024-11-09T02:49:33.584ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2fcb5796-073f-49ce-98cf-5fd0515b48ba", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41512024-11-09T02:49:33.584ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41522024-11-09T02:49:33.586ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41532024-11-09T02:49:33.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 418.766174ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41542024-11-09T02:49:33.604ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41552024-11-09T02:49:33.604ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41562024-11-09T02:49:33.606ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 438.866209ms iteration = 7 status = null
41572024-11-09T02:49:33.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41582024-11-09T02:49:33.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41592024-11-09T02:49:33.637ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
41602024-11-09T02:49:33.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41612024-11-09T02:49:33.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41622024-11-09T02:49:33.647ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41632024-11-09T02:49:33.647ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b75b9c6f-aeda-4da3-bda9-0d71cf0cb75f", "content-length": "134", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
41642024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41652024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
41662024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41672024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41682024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41692024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41702024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41712024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41722024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41732024-11-09T02:49:33.647ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41742024-11-09T02:49:33.648ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
41752024-11-09T02:49:33.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41762024-11-09T02:49:33.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41772024-11-09T02:49:33.650ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41782024-11-09T02:49:33.650ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "635b29fa-8506-47aa-8d65-466cbfc2d786", "content-length": "2", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
41792024-11-09T02:49:33.650ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41802024-11-09T02:49:33.650ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "486e1c17-d737-4f77-8eee-171b5f39626f", "content-length": "52", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
41812024-11-09T02:49:33.650ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
41822024-11-09T02:49:33.650ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41832024-11-09T02:49:33.679ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "272a9163-3a84-4cfb-b343-80de2d3e68bb", "content-length": "372", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
41842024-11-09T02:49:33.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41852024-11-09T02:49:33.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41862024-11-09T02:49:33.727ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41872024-11-09T02:49:33.727ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41882024-11-09T02:49:33.727ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ae703ad8-89ad-42d5-ad52-d5b795616fee", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
41892024-11-09T02:49:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41902024-11-09T02:49:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41912024-11-09T02:49:33.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41922024-11-09T02:49:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41932024-11-09T02:49:33.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41942024-11-09T02:49:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41952024-11-09T02:49:33.737ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41962024-11-09T02:49:33.737ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41972024-11-09T02:49:33.738ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0934d46-d095-4a2e-8471-25d0aa5f565f", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
41982024-11-09T02:49:33.739ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 572.44654ms iteration = 7 status = {}
41992024-11-09T02:49:33.778ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "14abfc8f-4310-4d38-9943-4a4b615162be", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
42002024-11-09T02:49:33.778ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
42012024-11-09T02:49:33.778ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42022024-11-09T02:49:33.778ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "862f9d7e-1f9f-4c65-96e7-92203186471d", "content-length": "682", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
42032024-11-09T02:49:33.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42042024-11-09T02:49:33.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42052024-11-09T02:49:33.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42062024-11-09T02:49:33.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42072024-11-09T02:49:33.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42082024-11-09T02:49:33.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42092024-11-09T02:49:33.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42102024-11-09T02:49:33.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42112024-11-09T02:49:33.794ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.539918ms iteration = 7 status = {}
42122024-11-09T02:49:33.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e46ce22b-dd40-460f-949f-dff4e14a8ec2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42132024-11-09T02:49:33.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e46ce22b-dd40-460f-949f-dff4e14a8ec2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42142024-11-09T02:49:33.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e46ce22b-dd40-460f-949f-dff4e14a8ec2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42152024-11-09T02:49:34.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a89ceecb-4303-4deb-aa7c-251d0b9bcf36 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42162024-11-09T02:49:34.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a89ceecb-4303-4deb-aa7c-251d0b9bcf36 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42172024-11-09T02:49:34.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a89ceecb-4303-4deb-aa7c-251d0b9bcf36 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42182024-11-09T02:49:35.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e641e50-dd54-4456-9fd4-d7e44327c250 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42192024-11-09T02:49:35.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e641e50-dd54-4456-9fd4-d7e44327c250 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42202024-11-09T02:49:35.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e641e50-dd54-4456-9fd4-d7e44327c250 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42212024-11-09T02:49:35.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 59990cf7-5ac3-4bfd-aa5d-579e10b4a24d roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
42222024-11-09T02:49:35.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 59990cf7-5ac3-4bfd-aa5d-579e10b4a24d resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
42232024-11-09T02:49:35.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 59990cf7-5ac3-4bfd-aa5d-579e10b4a24d response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
42242024-11-09T02:49:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = fdba6720-6954-497a-bb39-698956218894 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
42252024-11-09T02:49:35.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = fdba6720-6954-497a-bb39-698956218894 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
42262024-11-09T02:49:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = fdba6720-6954-497a-bb39-698956218894 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
42272024-11-09T02:49:36.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be81423c-5dc3-47c4-b24d-15661d83496c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42282024-11-09T02:49:36.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be81423c-5dc3-47c4-b24d-15661d83496c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42292024-11-09T02:49:36.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be81423c-5dc3-47c4-b24d-15661d83496c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42302024-11-09T02:49:37.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a14eb46c-64a8-4c5e-bb3f-9ea7cc2067fd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42312024-11-09T02:49:37.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a14eb46c-64a8-4c5e-bb3f-9ea7cc2067fd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42322024-11-09T02:49:37.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a14eb46c-64a8-4c5e-bb3f-9ea7cc2067fd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42332024-11-09T02:49:38.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f44dad98-1440-489b-a582-7ae7797aae0d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42342024-11-09T02:49:38.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f44dad98-1440-489b-a582-7ae7797aae0d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42352024-11-09T02:49:38.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f44dad98-1440-489b-a582-7ae7797aae0d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42362024-11-09T02:49:39.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5d597d3e-2eb3-401b-823f-be0e1fb9511f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42372024-11-09T02:49:39.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5d597d3e-2eb3-401b-823f-be0e1fb9511f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42382024-11-09T02:49:39.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5d597d3e-2eb3-401b-823f-be0e1fb9511f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42392024-11-09T02:49:40.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28099301-77eb-4994-900c-2761242fc802 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42402024-11-09T02:49:40.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28099301-77eb-4994-900c-2761242fc802 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42412024-11-09T02:49:40.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28099301-77eb-4994-900c-2761242fc802 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42422024-11-09T02:49:41.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 31a5f83e-22c2-4adb-8287-e95a0477baf2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42432024-11-09T02:49:41.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 31a5f83e-22c2-4adb-8287-e95a0477baf2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42442024-11-09T02:49:41.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 31a5f83e-22c2-4adb-8287-e95a0477baf2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42452024-11-09T02:49:42.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b0b8812-1572-4d15-bb73-80c77368aec5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42462024-11-09T02:49:42.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b0b8812-1572-4d15-bb73-80c77368aec5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42472024-11-09T02:49:42.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b0b8812-1572-4d15-bb73-80c77368aec5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42482024-11-09T02:49:43.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
42492024-11-09T02:49:43.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
42502024-11-09T02:49:43.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42512024-11-09T02:49:43.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42522024-11-09T02:49:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42532024-11-09T02:49:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42542024-11-09T02:49:43.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42552024-11-09T02:49:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42562024-11-09T02:49:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42572024-11-09T02:49:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42582024-11-09T02:49:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42592024-11-09T02:49:43.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42602024-11-09T02:49:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42612024-11-09T02:49:43.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
42622024-11-09T02:49:43.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42632024-11-09T02:49:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42642024-11-09T02:49:43.188ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
42652024-11-09T02:49:43.188ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.336352ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
42662024-11-09T02:49:43.195ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42672024-11-09T02:49:43.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42682024-11-09T02:49:43.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.481706ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42692024-11-09T02:49:43.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 66f4d34f-731e-4099-b267-79998102d228 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42702024-11-09T02:49:43.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 66f4d34f-731e-4099-b267-79998102d228 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42712024-11-09T02:49:43.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 66f4d34f-731e-4099-b267-79998102d228 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42722024-11-09T02:49:44.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 784812cc-8bdc-452c-8de8-fbaab9dde327 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42732024-11-09T02:49:44.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 784812cc-8bdc-452c-8de8-fbaab9dde327 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42742024-11-09T02:49:44.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 784812cc-8bdc-452c-8de8-fbaab9dde327 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42752024-11-09T02:49:45.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 907 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 13012c9f-f8ca-4c4a-bca9-57b74374b730 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
42762024-11-09T02:49:45.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 10069971-358a-483e-bc52-5e83f5d3ce4b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42772024-11-09T02:49:45.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 10069971-358a-483e-bc52-5e83f5d3ce4b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42782024-11-09T02:49:45.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 10069971-358a-483e-bc52-5e83f5d3ce4b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42792024-11-09T02:49:46.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90075266-f275-44ac-86d2-8a40693177b9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42802024-11-09T02:49:46.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90075266-f275-44ac-86d2-8a40693177b9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42812024-11-09T02:49:46.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90075266-f275-44ac-86d2-8a40693177b9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42822024-11-09T02:49:47.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5608f392-4725-422c-8e12-8a7d6aebc56b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42832024-11-09T02:49:47.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5608f392-4725-422c-8e12-8a7d6aebc56b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42842024-11-09T02:49:47.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5608f392-4725-422c-8e12-8a7d6aebc56b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42852024-11-09T02:49:48.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a4e51ad7-17ed-4e95-b681-1b563aab1b68 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42862024-11-09T02:49:48.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a4e51ad7-17ed-4e95-b681-1b563aab1b68 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42872024-11-09T02:49:48.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a4e51ad7-17ed-4e95-b681-1b563aab1b68 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42882024-11-09T02:49:49.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f7ee4a7-b76e-4f7b-aa96-b789773f1ffc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42892024-11-09T02:49:49.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f7ee4a7-b76e-4f7b-aa96-b789773f1ffc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42902024-11-09T02:49:49.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f7ee4a7-b76e-4f7b-aa96-b789773f1ffc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42912024-11-09T02:49:50.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = e3d18f26-e3a2-4f2f-b909-530ad84c344a roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
42922024-11-09T02:49:50.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = e3d18f26-e3a2-4f2f-b909-530ad84c344a resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
42932024-11-09T02:49:50.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = e3d18f26-e3a2-4f2f-b909-530ad84c344a response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
42942024-11-09T02:49:50.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 1d436949-b264-4233-9381-3cd27f36196b roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
42952024-11-09T02:49:50.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 1d436949-b264-4233-9381-3cd27f36196b resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
42962024-11-09T02:49:50.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 1d436949-b264-4233-9381-3cd27f36196b response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
42972024-11-09T02:49:50.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f375d463-eeb5-4ed9-8085-0c79936cfda9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42982024-11-09T02:49:50.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f375d463-eeb5-4ed9-8085-0c79936cfda9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
42992024-11-09T02:49:50.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f375d463-eeb5-4ed9-8085-0c79936cfda9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43002024-11-09T02:49:51.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ecf448bb-fb4b-4a3d-a008-68caf50c8bab roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43012024-11-09T02:49:51.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ecf448bb-fb4b-4a3d-a008-68caf50c8bab resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43022024-11-09T02:49:51.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ecf448bb-fb4b-4a3d-a008-68caf50c8bab response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43032024-11-09T02:49:52.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 614da821-effc-49a5-a849-a7cedd67a1f0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43042024-11-09T02:49:52.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 614da821-effc-49a5-a849-a7cedd67a1f0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43052024-11-09T02:49:52.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 614da821-effc-49a5-a849-a7cedd67a1f0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43062024-11-09T02:49:53.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
43072024-11-09T02:49:53.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
43082024-11-09T02:49:53.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43092024-11-09T02:49:53.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43102024-11-09T02:49:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43112024-11-09T02:49:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43122024-11-09T02:49:53.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43132024-11-09T02:49:53.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43142024-11-09T02:49:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43152024-11-09T02:49:53.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.562514ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43162024-11-09T02:49:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43172024-11-09T02:49:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43182024-11-09T02:49:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43192024-11-09T02:49:53.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43202024-11-09T02:49:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43212024-11-09T02:49:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43222024-11-09T02:49:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
43232024-11-09T02:49:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43242024-11-09T02:49:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43252024-11-09T02:49:53.188ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
43262024-11-09T02:49:53.188ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.117257ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
43272024-11-09T02:49:53.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 928972b3-a556-4b46-bce7-710d0e403445 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43282024-11-09T02:49:53.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 928972b3-a556-4b46-bce7-710d0e403445 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43292024-11-09T02:49:53.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 928972b3-a556-4b46-bce7-710d0e403445 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43302024-11-09T02:49:54.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca383a66-8a92-4ddf-8d72-57a15d66adfc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43312024-11-09T02:49:54.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca383a66-8a92-4ddf-8d72-57a15d66adfc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43322024-11-09T02:49:54.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca383a66-8a92-4ddf-8d72-57a15d66adfc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43332024-11-09T02:49:55.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e65372d5-9aa8-4bed-9365-a1aa1c8a5de6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43342024-11-09T02:49:55.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e65372d5-9aa8-4bed-9365-a1aa1c8a5de6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43352024-11-09T02:49:55.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e65372d5-9aa8-4bed-9365-a1aa1c8a5de6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43362024-11-09T02:49:56.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3bc6c26-642a-4f10-963a-39568a9ac10f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43372024-11-09T02:49:56.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3bc6c26-642a-4f10-963a-39568a9ac10f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43382024-11-09T02:49:56.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3bc6c26-642a-4f10-963a-39568a9ac10f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43392024-11-09T02:49:57.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 456e21bf-0faa-4ac6-9581-f5664c3eb745 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43402024-11-09T02:49:57.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 456e21bf-0faa-4ac6-9581-f5664c3eb745 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43412024-11-09T02:49:57.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 456e21bf-0faa-4ac6-9581-f5664c3eb745 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43422024-11-09T02:49:58.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cecef164-71e5-4d11-8160-3e206d652cbe roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43432024-11-09T02:49:58.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cecef164-71e5-4d11-8160-3e206d652cbe resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43442024-11-09T02:49:58.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cecef164-71e5-4d11-8160-3e206d652cbe response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43452024-11-09T02:49:59.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a310e91-db3e-46af-8b69-6fc4ea883559 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43462024-11-09T02:49:59.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a310e91-db3e-46af-8b69-6fc4ea883559 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43472024-11-09T02:49:59.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a310e91-db3e-46af-8b69-6fc4ea883559 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43482024-11-09T02:50:00.147ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 706 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 4b1d4c7f-2309-4dbd-aaf5-be87bfb25431 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
43492024-11-09T02:50:00.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8e01cad1-8eb9-4fb6-a30f-1483738e5e11 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43502024-11-09T02:50:00.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8e01cad1-8eb9-4fb6-a30f-1483738e5e11 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43512024-11-09T02:50:00.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8e01cad1-8eb9-4fb6-a30f-1483738e5e11 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43522024-11-09T02:50:01.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a565738b-1d68-4751-82ce-3c1b4340726a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43532024-11-09T02:50:01.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a565738b-1d68-4751-82ce-3c1b4340726a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43542024-11-09T02:50:01.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a565738b-1d68-4751-82ce-3c1b4340726a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43552024-11-09T02:50:02.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bc4b873d-c2cf-4173-a529-d97dce6be6ea roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43562024-11-09T02:50:02.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bc4b873d-c2cf-4173-a529-d97dce6be6ea resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43572024-11-09T02:50:02.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bc4b873d-c2cf-4173-a529-d97dce6be6ea response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
43582024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
43592024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43602024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
43612024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43622024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
43632024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43642024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43652024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
43662024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
43672024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43682024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
43692024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43702024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
43712024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43722024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
43732024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43742024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
43752024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43762024-11-09T02:50:03.167ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43772024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43782024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
43792024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43802024-11-09T02:50:03.167ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
43812024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
43822024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43832024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
43842024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43852024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
43862024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.14\u{b5}s iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43872024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
43882024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
43892024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.16\u{b5}s iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
43902024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.44\u{b5}s iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43912024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
43922024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.13\u{b5}s iteration = 8 status = {"errors":[],"records_set_to_done":[]}
43932024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43942024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43952024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43962024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43972024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43982024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43992024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44002024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44012024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44022024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44032024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44042024-11-09T02:50:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44052024-11-09T02:50:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44062024-11-09T02:50:03.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44072024-11-09T02:50:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.998203ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44082024-11-09T02:50:03.172ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44092024-11-09T02:50:03.172ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44102024-11-09T02:50:03.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44112024-11-09T02:50:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44122024-11-09T02:50:03.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44132024-11-09T02:50:03.172ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1106, tv_nsec: 512134282 } })
44142024-11-09T02:50:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44152024-11-09T02:50:03.173ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
44162024-11-09T02:50:03.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44172024-11-09T02:50:03.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44182024-11-09T02:50:03.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44192024-11-09T02:50:03.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44202024-11-09T02:50:03.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44212024-11-09T02:50:03.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44222024-11-09T02:50:03.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1106, tv_nsec: 515901610 } })
44232024-11-09T02:50:03.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
44242024-11-09T02:50:03.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-11-09T02:50:03.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-11-09T02:50:03.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44272024-11-09T02:50:03.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44282024-11-09T02:50:03.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44292024-11-09T02:50:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44302024-11-09T02:50:03.182ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44312024-11-09T02:50:03.182ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44322024-11-09T02:50:03.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44332024-11-09T02:50:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44342024-11-09T02:50:03.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44352024-11-09T02:50:03.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44362024-11-09T02:50:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44372024-11-09T02:50:03.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44382024-11-09T02:50:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44392024-11-09T02:50:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44402024-11-09T02:50:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44412024-11-09T02:50:03.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44422024-11-09T02:50:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44432024-11-09T02:50:03.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44442024-11-09T02:50:03.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44452024-11-09T02:50:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44462024-11-09T02:50:03.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44472024-11-09T02:50:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44482024-11-09T02:50:03.190ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1106, tv_nsec: 529978451 } })
44492024-11-09T02:50:03.190ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
44502024-11-09T02:50:03.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44512024-11-09T02:50:03.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44522024-11-09T02:50:03.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44532024-11-09T02:50:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44542024-11-09T02:50:03.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44552024-11-09T02:50:03.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44562024-11-09T02:50:03.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44572024-11-09T02:50:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44582024-11-09T02:50:03.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592024-11-09T02:50:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44602024-11-09T02:50:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44612024-11-09T02:50:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
44622024-11-09T02:50:03.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44632024-11-09T02:50:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44642024-11-09T02:50:03.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.024221ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44652024-11-09T02:50:03.230ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.008442ms iteration = 8 status = 0
44662024-11-09T02:50:03.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-11-09T02:50:03.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682024-11-09T02:50:03.232ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44692024-11-09T02:50:03.232ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44702024-11-09T02:50:03.232ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 64.586135ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44712024-11-09T02:50:03.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44722024-11-09T02:50:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44732024-11-09T02:50:03.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
44742024-11-09T02:50:03.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44752024-11-09T02:50:03.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44762024-11-09T02:50:03.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44772024-11-09T02:50:03.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44782024-11-09T02:50:03.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44792024-11-09T02:50:03.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.100817ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44802024-11-09T02:50:03.241ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44812024-11-09T02:50:03.241ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.383167ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44822024-11-09T02:50:03.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
44832024-11-09T02:50:03.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.643408ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
44842024-11-09T02:50:03.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44852024-11-09T02:50:03.257ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44862024-11-09T02:50:03.257ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03658917-feba-474c-8c12-5a9b6d563d9e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
44872024-11-09T02:50:03.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44882024-11-09T02:50:03.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44892024-11-09T02:50:03.269ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44902024-11-09T02:50:03.269ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44912024-11-09T02:50:03.269ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1060e24e-c2c4-4c31-bcda-4e8288e28338", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
44922024-11-09T02:50:03.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44932024-11-09T02:50:03.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44942024-11-09T02:50:03.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44952024-11-09T02:50:03.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44962024-11-09T02:50:03.288ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
44972024-11-09T02:50:03.288ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44982024-11-09T02:50:03.289ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82e2bb11-6eba-407d-bf39-93d37045bbd6", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
44992024-11-09T02:50:03.289ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45002024-11-09T02:50:03.290ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
45012024-11-09T02:50:03.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45022024-11-09T02:50:03.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45032024-11-09T02:50:03.327ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.937965ms iteration = 10 status = {"physical_disks_added":0}
45042024-11-09T02:50:03.358ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45052024-11-09T02:50:03.359ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "22d9161b-982b-4c0f-b86f-25128a601ede", "content-length": "1", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45062024-11-09T02:50:03.360ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45072024-11-09T02:50:03.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45082024-11-09T02:50:03.370ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45092024-11-09T02:50:03.370ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45102024-11-09T02:50:03.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112024-11-09T02:50:03.373ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.796003ms iteration = 8 status = null
45122024-11-09T02:50:03.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45132024-11-09T02:50:03.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45142024-11-09T02:50:03.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45152024-11-09T02:50:03.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45162024-11-09T02:50:03.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45172024-11-09T02:50:03.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45182024-11-09T02:50:03.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45192024-11-09T02:50:03.377ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 209.855966ms iteration = 8 status = {}
45202024-11-09T02:50:03.425ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "11741af5-6039-4ea0-b4d7-ef13609e4f7b", "content-length": "372", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45212024-11-09T02:50:03.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45222024-11-09T02:50:03.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45232024-11-09T02:50:03.436ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45242024-11-09T02:50:03.437ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "da265861-ee87-4117-9ed7-0462db87f342", "content-length": "691", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45252024-11-09T02:50:03.437ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45262024-11-09T02:50:03.437ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45272024-11-09T02:50:03.437ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45282024-11-09T02:50:03.438ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 270.946658ms iteration = 8 status = {}
45292024-11-09T02:50:03.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45302024-11-09T02:50:03.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45312024-11-09T02:50:03.474ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
45322024-11-09T02:50:03.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45332024-11-09T02:50:03.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45342024-11-09T02:50:03.475ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45352024-11-09T02:50:03.475ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45362024-11-09T02:50:03.484ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45372024-11-09T02:50:03.485ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "52eceaf6-ee04-4013-a477-a256b27be65c", "content-length": "134", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45382024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45392024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
45402024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45412024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45422024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45432024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45442024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45452024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45462024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45472024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45482024-11-09T02:50:03.485ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
45492024-11-09T02:50:03.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45502024-11-09T02:50:03.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45512024-11-09T02:50:03.487ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45522024-11-09T02:50:03.487ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d70e7746-3400-4410-8fe6-ed1f4f047e38", "content-length": "2", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45532024-11-09T02:50:03.487ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45542024-11-09T02:50:03.488ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f335c31-7d4e-4a96-8b4d-440c5ca5ac4b", "content-length": "52", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45552024-11-09T02:50:03.488ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
45562024-11-09T02:50:03.488ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45572024-11-09T02:50:03.549ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d1b6ef18-8182-4f2d-a64b-dc721816d835", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45582024-11-09T02:50:03.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45592024-11-09T02:50:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45602024-11-09T02:50:03.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45612024-11-09T02:50:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45622024-11-09T02:50:03.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45632024-11-09T02:50:03.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45642024-11-09T02:50:03.560ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45652024-11-09T02:50:03.560ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45662024-11-09T02:50:03.560ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ee733ef5-5fd4-4c28-ac35-ea6e23eb6112", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45672024-11-09T02:50:03.561ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 393.792248ms iteration = 8 status = {}
45682024-11-09T02:50:03.648ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2051c39a-65b5-4eec-a10d-7d7d2bb4d2a0", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45692024-11-09T02:50:03.648ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
45702024-11-09T02:50:03.648ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45712024-11-09T02:50:03.648ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "79ee6dd7-9439-4312-92da-f3c1ba6bab45", "content-length": "682", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45722024-11-09T02:50:03.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45732024-11-09T02:50:03.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45742024-11-09T02:50:03.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45752024-11-09T02:50:03.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45762024-11-09T02:50:03.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45772024-11-09T02:50:03.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45782024-11-09T02:50:03.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45792024-11-09T02:50:03.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45802024-11-09T02:50:03.666ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 498.330578ms iteration = 8 status = {}
45812024-11-09T02:50:03.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f1761baf-63d9-4318-9a03-1c9b5abebf74 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
45822024-11-09T02:50:03.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f1761baf-63d9-4318-9a03-1c9b5abebf74 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
45832024-11-09T02:50:03.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f1761baf-63d9-4318-9a03-1c9b5abebf74 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
45842024-11-09T02:50:03.743ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
45852024-11-09T02:50:03.743ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
45862024-11-09T02:50:03.773ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
45872024-11-09T02:50:03.773ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:44702
45882024-11-09T02:50:03.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44702 req_id = 73c051bd-bcde-42ba-acee-82aa104bb500 roles = RoleSet { roles: {} } uri = /metrics/producers
45892024-11-09T02:50:03.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44702 req_id = 73c051bd-bcde-42ba-acee-82aa104bb500 resource = Database result = Ok(()) uri = /metrics/producers
45902024-11-09T02:50:03.813ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
45912024-11-09T02:50:03.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40071 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44702 req_id = 73c051bd-bcde-42ba-acee-82aa104bb500 response_code = 201 uri = /metrics/producers
45922024-11-09T02:50:03.813ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "73c051bd-bcde-42ba-acee-82aa104bb500", "content-length": "41", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
45932024-11-09T02:50:03.814ZDEBGnexus (producer-registration-task): registered with nexus successfully
45942024-11-09T02:50:03.814ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
45952024-11-09T02:50:03.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 1ff16d47-7089-4186-99ca-e1eae788f551 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
45962024-11-09T02:50:03.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 1ff16d47-7089-4186-99ca-e1eae788f551 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
45972024-11-09T02:50:03.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 1ff16d47-7089-4186-99ca-e1eae788f551 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
45982024-11-09T02:50:04.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 796d6057-be60-4d37-a2f2-3e7faf077142 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
45992024-11-09T02:50:04.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 796d6057-be60-4d37-a2f2-3e7faf077142 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46002024-11-09T02:50:04.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 796d6057-be60-4d37-a2f2-3e7faf077142 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46012024-11-09T02:50:05.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f127e5f5-ef72-4a6e-968d-c1254a50251f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
46022024-11-09T02:50:05.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f127e5f5-ef72-4a6e-968d-c1254a50251f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
46032024-11-09T02:50:05.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f127e5f5-ef72-4a6e-968d-c1254a50251f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
46042024-11-09T02:50:05.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 487d6b3e-1a67-40a7-9d3e-768d3bbf851e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
46052024-11-09T02:50:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 487d6b3e-1a67-40a7-9d3e-768d3bbf851e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
46062024-11-09T02:50:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 487d6b3e-1a67-40a7-9d3e-768d3bbf851e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
46072024-11-09T02:50:05.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d394ae4e-c359-4bc0-804f-1344297f9a73 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46082024-11-09T02:50:05.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d394ae4e-c359-4bc0-804f-1344297f9a73 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46092024-11-09T02:50:05.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d394ae4e-c359-4bc0-804f-1344297f9a73 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46102024-11-09T02:50:06.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 903ce429-b581-4142-a8c3-6eaf0138391a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46112024-11-09T02:50:06.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 903ce429-b581-4142-a8c3-6eaf0138391a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46122024-11-09T02:50:06.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 903ce429-b581-4142-a8c3-6eaf0138391a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46132024-11-09T02:50:07.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ee0ddb1-afd9-4f09-87e7-350edb9abe85 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46142024-11-09T02:50:07.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ee0ddb1-afd9-4f09-87e7-350edb9abe85 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46152024-11-09T02:50:07.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ee0ddb1-afd9-4f09-87e7-350edb9abe85 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46162024-11-09T02:50:08.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 75b99f74-4bfb-4e9d-b805-1ad2e55354e8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46172024-11-09T02:50:08.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 75b99f74-4bfb-4e9d-b805-1ad2e55354e8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46182024-11-09T02:50:08.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 75b99f74-4bfb-4e9d-b805-1ad2e55354e8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46192024-11-09T02:50:09.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 038f465a-8e0b-4bc8-9c40-85ff407a42e8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46202024-11-09T02:50:09.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 038f465a-8e0b-4bc8-9c40-85ff407a42e8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46212024-11-09T02:50:09.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 038f465a-8e0b-4bc8-9c40-85ff407a42e8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46222024-11-09T02:50:10.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39ae1871-7396-4d80-9173-0962b74a35b4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46232024-11-09T02:50:10.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39ae1871-7396-4d80-9173-0962b74a35b4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46242024-11-09T02:50:10.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39ae1871-7396-4d80-9173-0962b74a35b4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46252024-11-09T02:50:11.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9a243f2b-1578-4598-8d89-d6cae1cd0d7b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46262024-11-09T02:50:11.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9a243f2b-1578-4598-8d89-d6cae1cd0d7b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46272024-11-09T02:50:11.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9a243f2b-1578-4598-8d89-d6cae1cd0d7b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46282024-11-09T02:50:12.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c84c423d-c61a-418b-b782-ef8bbb8e4a31 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46292024-11-09T02:50:12.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c84c423d-c61a-418b-b782-ef8bbb8e4a31 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46302024-11-09T02:50:12.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c84c423d-c61a-418b-b782-ef8bbb8e4a31 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46312024-11-09T02:50:13.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
46322024-11-09T02:50:13.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
46332024-11-09T02:50:13.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46342024-11-09T02:50:13.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46352024-11-09T02:50:13.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46362024-11-09T02:50:13.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46372024-11-09T02:50:13.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46382024-11-09T02:50:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46392024-11-09T02:50:13.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46402024-11-09T02:50:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46412024-11-09T02:50:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46422024-11-09T02:50:13.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46432024-11-09T02:50:13.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46442024-11-09T02:50:13.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
46452024-11-09T02:50:13.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46462024-11-09T02:50:13.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46472024-11-09T02:50:13.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
46482024-11-09T02:50:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.071378ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
46492024-11-09T02:50:13.199ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46502024-11-09T02:50:13.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46512024-11-09T02:50:13.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.461881ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46522024-11-09T02:50:13.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 380030bc-6aed-4081-b58e-c17a7928e678 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46532024-11-09T02:50:13.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 380030bc-6aed-4081-b58e-c17a7928e678 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46542024-11-09T02:50:13.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 380030bc-6aed-4081-b58e-c17a7928e678 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46552024-11-09T02:50:14.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9dcd201-e48a-4b9b-9029-fca69e8179ad roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46562024-11-09T02:50:14.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9dcd201-e48a-4b9b-9029-fca69e8179ad resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46572024-11-09T02:50:14.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9dcd201-e48a-4b9b-9029-fca69e8179ad response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46582024-11-09T02:50:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 767 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c599a310-cc99-44b5-9d7e-47e4e2efc698 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
46592024-11-09T02:50:15.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bd833e30-933e-466a-b90b-dd701bf1db9f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46602024-11-09T02:50:15.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bd833e30-933e-466a-b90b-dd701bf1db9f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46612024-11-09T02:50:15.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bd833e30-933e-466a-b90b-dd701bf1db9f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46622024-11-09T02:50:16.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a6f6fe70-d19b-46cc-9956-c9adeaa375cd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46632024-11-09T02:50:16.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a6f6fe70-d19b-46cc-9956-c9adeaa375cd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46642024-11-09T02:50:16.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a6f6fe70-d19b-46cc-9956-c9adeaa375cd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46652024-11-09T02:50:17.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff0074ba-af2d-4ef2-9e7a-9874fb6b5c4d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46662024-11-09T02:50:17.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff0074ba-af2d-4ef2-9e7a-9874fb6b5c4d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46672024-11-09T02:50:17.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff0074ba-af2d-4ef2-9e7a-9874fb6b5c4d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46682024-11-09T02:50:19.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a04160ed-f49d-476f-afe3-dac087f8d8c7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46692024-11-09T02:50:19.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a04160ed-f49d-476f-afe3-dac087f8d8c7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46702024-11-09T02:50:19.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a04160ed-f49d-476f-afe3-dac087f8d8c7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46712024-11-09T02:50:20.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7802de53-6e94-4645-b1ec-b8fe233f19ee roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46722024-11-09T02:50:20.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7802de53-6e94-4645-b1ec-b8fe233f19ee resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46732024-11-09T02:50:20.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7802de53-6e94-4645-b1ec-b8fe233f19ee response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46742024-11-09T02:50:21.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 486efe03-b89d-464a-9aab-3936a2c29ea7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46752024-11-09T02:50:21.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 486efe03-b89d-464a-9aab-3936a2c29ea7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46762024-11-09T02:50:21.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 486efe03-b89d-464a-9aab-3936a2c29ea7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46772024-11-09T02:50:22.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2b7f7451-c3e7-414c-9092-ffd6bdce75d8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46782024-11-09T02:50:22.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2b7f7451-c3e7-414c-9092-ffd6bdce75d8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46792024-11-09T02:50:22.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2b7f7451-c3e7-414c-9092-ffd6bdce75d8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46802024-11-09T02:50:23.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0644ef04-df5a-4d4c-a0e4-f4e4f083c154 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46812024-11-09T02:50:23.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0644ef04-df5a-4d4c-a0e4-f4e4f083c154 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46822024-11-09T02:50:23.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0644ef04-df5a-4d4c-a0e4-f4e4f083c154 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
46832024-11-09T02:50:23.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
46842024-11-09T02:50:23.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
46852024-11-09T02:50:23.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46862024-11-09T02:50:23.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46872024-11-09T02:50:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46882024-11-09T02:50:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46892024-11-09T02:50:23.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46902024-11-09T02:50:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46912024-11-09T02:50:23.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-11-09T02:50:23.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.974951ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46932024-11-09T02:50:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46942024-11-09T02:50:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46952024-11-09T02:50:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46962024-11-09T02:50:23.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46972024-11-09T02:50:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46982024-11-09T02:50:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46992024-11-09T02:50:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
47002024-11-09T02:50:23.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47012024-11-09T02:50:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47022024-11-09T02:50:23.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
47032024-11-09T02:50:23.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.530256ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
47042024-11-09T02:50:24.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3021951c-9130-48e0-a384-5e331969455c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47052024-11-09T02:50:24.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3021951c-9130-48e0-a384-5e331969455c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47062024-11-09T02:50:24.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3021951c-9130-48e0-a384-5e331969455c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47072024-11-09T02:50:25.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fad41f2-9af4-4703-8348-032a88bae229 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47082024-11-09T02:50:25.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fad41f2-9af4-4703-8348-032a88bae229 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47092024-11-09T02:50:25.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fad41f2-9af4-4703-8348-032a88bae229 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47102024-11-09T02:50:26.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e0ca82db-32f1-48d6-a557-bf565b6defa7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47112024-11-09T02:50:26.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e0ca82db-32f1-48d6-a557-bf565b6defa7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47122024-11-09T02:50:26.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e0ca82db-32f1-48d6-a557-bf565b6defa7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47132024-11-09T02:50:27.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3ea159ee-775b-4404-874e-220057c8f21c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47142024-11-09T02:50:27.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3ea159ee-775b-4404-874e-220057c8f21c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47152024-11-09T02:50:27.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3ea159ee-775b-4404-874e-220057c8f21c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47162024-11-09T02:50:28.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 50052ca5-db35-47b7-87f6-232621e7bd0b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47172024-11-09T02:50:28.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 50052ca5-db35-47b7-87f6-232621e7bd0b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47182024-11-09T02:50:28.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 50052ca5-db35-47b7-87f6-232621e7bd0b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47192024-11-09T02:50:29.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb3ad73e-0e98-402f-b6b5-244781576316 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47202024-11-09T02:50:29.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb3ad73e-0e98-402f-b6b5-244781576316 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47212024-11-09T02:50:29.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb3ad73e-0e98-402f-b6b5-244781576316 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47222024-11-09T02:50:30.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 655 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 05a00c77-189e-436a-bbe7-d1cc2ce6586c response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
47232024-11-09T02:50:30.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03f59bcf-3a1c-4053-bd81-eeb204d76898 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47242024-11-09T02:50:30.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03f59bcf-3a1c-4053-bd81-eeb204d76898 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47252024-11-09T02:50:30.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03f59bcf-3a1c-4053-bd81-eeb204d76898 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47262024-11-09T02:50:31.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46916572-8d07-4a01-8813-63fbd72883e3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47272024-11-09T02:50:31.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46916572-8d07-4a01-8813-63fbd72883e3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47282024-11-09T02:50:31.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46916572-8d07-4a01-8813-63fbd72883e3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47292024-11-09T02:50:32.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 73b3af31-6d7f-4dc4-ae6d-8dc4833aa977 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47302024-11-09T02:50:32.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 73b3af31-6d7f-4dc4-ae6d-8dc4833aa977 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47312024-11-09T02:50:32.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 73b3af31-6d7f-4dc4-ae6d-8dc4833aa977 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
47322024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
47332024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
47342024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47352024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47362024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47372024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
47382024-11-09T02:50:33.167ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47392024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
47402024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47412024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47422024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
47432024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
47442024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47452024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47462024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
47472024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47482024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
47492024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47502024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
47512024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
47522024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47532024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47542024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
47552024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
47562024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47572024-11-09T02:50:33.167ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47582024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47592024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
47602024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
47612024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
47622024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
47632024-11-09T02:50:33.168ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47642024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47652024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47662024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
47672024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47682024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
47692024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
47702024-11-09T02:50:33.168ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:40:33.168023071 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47712024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47722024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
47732024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
47742024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
47752024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47762024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47772024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
47782024-11-09T02:50:33.168ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
47792024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.9\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
47802024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
47812024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47822024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
47832024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.74\u{b5}s iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47842024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
47852024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
47862024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.34\u{b5}s iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47872024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
47882024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.2\u{b5}s iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
47892024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
47902024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
47912024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
47922024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
47932024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.16\u{b5}s iteration = 9 status = {"errors":[],"records_set_to_done":[]}
47942024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47952024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47962024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47972024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47982024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47992024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48002024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48012024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48022024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48032024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48042024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48052024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48062024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48072024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48082024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48092024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48102024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48112024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48122024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48132024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48142024-11-09T02:50:33.168ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 507944406 } })
48152024-11-09T02:50:33.168ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 508103799 } })
48162024-11-09T02:50:33.169ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48172024-11-09T02:50:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.402029ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48182024-11-09T02:50:33.169ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
48192024-11-09T02:50:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.500391ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
48202024-11-09T02:50:33.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48212024-11-09T02:50:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48222024-11-09T02:50:33.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48232024-11-09T02:50:33.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48242024-11-09T02:50:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.917062ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48252024-11-09T02:50:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48262024-11-09T02:50:33.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48272024-11-09T02:50:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48282024-11-09T02:50:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48292024-11-09T02:50:33.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48302024-11-09T02:50:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48312024-11-09T02:50:33.179ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 519020865 } })
48322024-11-09T02:50:33.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48332024-11-09T02:50:33.180ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
48342024-11-09T02:50:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48352024-11-09T02:50:33.183ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 521829563 } })
48362024-11-09T02:50:33.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
48372024-11-09T02:50:33.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48382024-11-09T02:50:33.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48392024-11-09T02:50:33.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48402024-11-09T02:50:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48412024-11-09T02:50:33.187ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422024-11-09T02:50:33.189ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.589616ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
48432024-11-09T02:50:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48442024-11-09T02:50:33.191ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48452024-11-09T02:50:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48462024-11-09T02:50:33.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48472024-11-09T02:50:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48482024-11-09T02:50:33.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48492024-11-09T02:50:33.207ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:40:33.168023071 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48502024-11-09T02:50:33.207ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 39.445945ms iteration = 5 status = {"expiration":"2024-11-09T02:40:33.168023071Z","pruned":[]}
48512024-11-09T02:50:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48522024-11-09T02:50:33.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48532024-11-09T02:50:33.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48542024-11-09T02:50:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48552024-11-09T02:50:33.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48562024-11-09T02:50:33.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48572024-11-09T02:50:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48582024-11-09T02:50:33.215ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
48592024-11-09T02:50:33.215ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
48602024-11-09T02:50:33.215ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
48612024-11-09T02:50:33.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48622024-11-09T02:50:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48632024-11-09T02:50:33.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48642024-11-09T02:50:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48652024-11-09T02:50:33.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48662024-11-09T02:50:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48672024-11-09T02:50:33.229ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
48682024-11-09T02:50:33.229ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
48692024-11-09T02:50:33.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48702024-11-09T02:50:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48712024-11-09T02:50:33.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48722024-11-09T02:50:33.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732024-11-09T02:50:33.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48742024-11-09T02:50:33.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48752024-11-09T02:50:33.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48762024-11-09T02:50:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48772024-11-09T02:50:33.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48782024-11-09T02:50:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48792024-11-09T02:50:33.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48802024-11-09T02:50:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48812024-11-09T02:50:33.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48822024-11-09T02:50:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48832024-11-09T02:50:33.243ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48842024-11-09T02:50:33.243ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48852024-11-09T02:50:33.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48862024-11-09T02:50:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48872024-11-09T02:50:33.245ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
48882024-11-09T02:50:33.245ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48892024-11-09T02:50:33.245ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
48902024-11-09T02:50:33.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 77.965371ms iteration = 5 status = {"generation":1}
48912024-11-09T02:50:33.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 586025939 } })
48922024-11-09T02:50:33.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
48932024-11-09T02:50:33.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48942024-11-09T02:50:33.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48952024-11-09T02:50:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48962024-11-09T02:50:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48972024-11-09T02:50:33.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48982024-11-09T02:50:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48992024-11-09T02:50:33.255ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49002024-11-09T02:50:33.255ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49012024-11-09T02:50:33.255ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.07873ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49022024-11-09T02:50:33.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49032024-11-09T02:50:33.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49042024-11-09T02:50:33.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49052024-11-09T02:50:33.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49062024-11-09T02:50:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49072024-11-09T02:50:33.262ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49082024-11-09T02:50:33.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49092024-11-09T02:50:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49102024-11-09T02:50:33.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49112024-11-09T02:50:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49122024-11-09T02:50:33.264ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
49132024-11-09T02:50:33.264ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
49142024-11-09T02:50:33.264ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 95.972393ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
49152024-11-09T02:50:33.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49162024-11-09T02:50:33.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49172024-11-09T02:50:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49182024-11-09T02:50:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49192024-11-09T02:50:33.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49202024-11-09T02:50:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49212024-11-09T02:50:33.269ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49222024-11-09T02:50:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49232024-11-09T02:50:33.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49242024-11-09T02:50:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49252024-11-09T02:50:33.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49262024-11-09T02:50:33.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49272024-11-09T02:50:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49282024-11-09T02:50:33.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49292024-11-09T02:50:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49302024-11-09T02:50:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
49312024-11-09T02:50:33.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49322024-11-09T02:50:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49332024-11-09T02:50:33.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49342024-11-09T02:50:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49352024-11-09T02:50:33.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.454329ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49362024-11-09T02:50:33.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49372024-11-09T02:50:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49382024-11-09T02:50:33.293ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49392024-11-09T02:50:33.293ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49402024-11-09T02:50:33.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49412024-11-09T02:50:33.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.212518ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49422024-11-09T02:50:33.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49432024-11-09T02:50:33.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
49442024-11-09T02:50:33.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.899184ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
49452024-11-09T02:50:33.298ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49462024-11-09T02:50:33.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49472024-11-09T02:50:33.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
49482024-11-09T02:50:33.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49492024-11-09T02:50:33.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49502024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49512024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49522024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49532024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49542024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49552024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49562024-11-09T02:50:33.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49572024-11-09T02:50:33.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 142.442824ms iteration = 9 status = 0
49582024-11-09T02:50:33.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49592024-11-09T02:50:33.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602024-11-09T02:50:33.312ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49612024-11-09T02:50:33.312ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 144.878774ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49622024-11-09T02:50:33.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49632024-11-09T02:50:33.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49642024-11-09T02:50:33.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49652024-11-09T02:50:33.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49662024-11-09T02:50:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49672024-11-09T02:50:33.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49682024-11-09T02:50:33.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49692024-11-09T02:50:33.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49702024-11-09T02:50:33.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49712024-11-09T02:50:33.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49722024-11-09T02:50:33.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49732024-11-09T02:50:33.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49742024-11-09T02:50:33.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752024-11-09T02:50:33.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
49762024-11-09T02:50:33.321ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49772024-11-09T02:50:33.321ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "30558dda-87e1-42b1-be44-2e9c7aa52520", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:32 GMT"} })
49782024-11-09T02:50:33.321ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49792024-11-09T02:50:33.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
49802024-11-09T02:50:33.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49812024-11-09T02:50:33.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49822024-11-09T02:50:33.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91f2bf0d-1014-4602-89f0-8da944e5746c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
49832024-11-09T02:50:33.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49842024-11-09T02:50:33.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91f2bf0d-1014-4602-89f0-8da944e5746c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
49852024-11-09T02:50:33.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49862024-11-09T02:50:33.342ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49872024-11-09T02:50:33.342ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49882024-11-09T02:50:33.342ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.371544ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49892024-11-09T02:50:33.350ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49902024-11-09T02:50:33.350ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
49912024-11-09T02:50:33.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49922024-11-09T02:50:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49932024-11-09T02:50:33.363ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
49942024-11-09T02:50:33.363ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 195.229095ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49952024-11-09T02:50:33.367ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
49962024-11-09T02:50:33.367ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49972024-11-09T02:50:33.368ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35df1798-b5f4-45b5-94ee-d597f253a302", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
49982024-11-09T02:50:33.368ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49992024-11-09T02:50:33.369ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50002024-11-09T02:50:33.393ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
50012024-11-09T02:50:33.393ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 225.567461ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
50022024-11-09T02:50:33.401ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 233.554676ms iteration = 11 status = {"physical_disks_added":0}
50032024-11-09T02:50:33.529ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
50042024-11-09T02:50:33.529ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50052024-11-09T02:50:33.529ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1e6615f-b443-40f9-a421-1c7a883135d8", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50062024-11-09T02:50:33.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50072024-11-09T02:50:33.530ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50082024-11-09T02:50:33.530ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
50092024-11-09T02:50:33.580ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 412.444343ms iteration = 9 status = {}
50102024-11-09T02:50:33.672ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50112024-11-09T02:50:33.673ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f8fc2887-ab6d-463d-8e38-40b88814fde4", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50122024-11-09T02:50:33.673ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50132024-11-09T02:50:33.675ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "11564cfe-fcfd-468b-ab9a-87125147f12e", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50142024-11-09T02:50:33.675ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50152024-11-09T02:50:33.677ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50162024-11-09T02:50:33.677ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 509.458148ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50172024-11-09T02:50:33.677ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50182024-11-09T02:50:33.677ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50192024-11-09T02:50:33.679ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1ace4b0-51f7-4751-b235-f80c3182d84f", "content-length": "372", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50202024-11-09T02:50:33.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50212024-11-09T02:50:33.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50222024-11-09T02:50:33.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50232024-11-09T02:50:33.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9b66c966-3435-482b-84d4-984a047ee3fb", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50242024-11-09T02:50:33.698ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50252024-11-09T02:50:33.699ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a442d3ac-b9c0-43b2-8c65-69e7ab61c2bb", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50262024-11-09T02:50:33.699ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50272024-11-09T02:50:33.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e73cabed-3eff-414a-b704-b3cb3fd42a78", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50282024-11-09T02:50:33.700ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50292024-11-09T02:50:33.701ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50302024-11-09T02:50:33.701ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 533.973765ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50312024-11-09T02:50:33.714ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50322024-11-09T02:50:33.715ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "530cd0ef-7d4a-40a9-b10b-bf27cf48bb82", "content-length": "691", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50332024-11-09T02:50:33.715ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50342024-11-09T02:50:33.715ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50352024-11-09T02:50:33.715ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50362024-11-09T02:50:33.715ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50372024-11-09T02:50:33.716ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccf61afa-9a4b-44ed-bfc2-f17bf4dd3a23", "content-length": "1", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50382024-11-09T02:50:33.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 394536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91f2bf0d-1014-4602-89f0-8da944e5746c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
50392024-11-09T02:50:33.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50402024-11-09T02:50:33.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50412024-11-09T02:50:33.718ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 550.548277ms iteration = 9 status = {}
50422024-11-09T02:50:33.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50432024-11-09T02:50:33.720ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.57583ms iteration = 9 status = null
50442024-11-09T02:50:33.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50452024-11-09T02:50:33.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50462024-11-09T02:50:33.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50472024-11-09T02:50:33.722ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
50482024-11-09T02:50:33.722ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50492024-11-09T02:50:33.722ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
50502024-11-09T02:50:33.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 554.895407ms iteration = 5 status = {"generation":2}
50512024-11-09T02:50:33.758ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50522024-11-09T02:50:33.758ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50532024-11-09T02:50:33.758ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7d09cc48-105f-48b6-839e-87d04540e8e1", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50542024-11-09T02:50:33.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50552024-11-09T02:50:33.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50562024-11-09T02:50:33.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50572024-11-09T02:50:33.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50582024-11-09T02:50:33.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50592024-11-09T02:50:33.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50602024-11-09T02:50:33.767ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50612024-11-09T02:50:33.767ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50622024-11-09T02:50:33.768ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4d245ab2-981e-42c2-a194-3530b1b37fd7", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50632024-11-09T02:50:33.769ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 602.079712ms iteration = 9 status = {}
50642024-11-09T02:50:33.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50652024-11-09T02:50:33.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50662024-11-09T02:50:33.773ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
50672024-11-09T02:50:33.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50682024-11-09T02:50:33.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50692024-11-09T02:50:33.784ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50702024-11-09T02:50:33.784ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25570886-8c13-47da-998f-a009c3995851", "content-length": "134", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50712024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50722024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
50732024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50742024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50752024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50762024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50772024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50782024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50792024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50802024-11-09T02:50:33.784ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50812024-11-09T02:50:33.785ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
50822024-11-09T02:50:33.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50832024-11-09T02:50:33.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50842024-11-09T02:50:33.787ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50852024-11-09T02:50:33.787ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fe942af-9451-452f-a07c-b936ecfa5af2", "content-length": "2", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50862024-11-09T02:50:33.787ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50872024-11-09T02:50:33.787ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d185e40b-94c4-4f01-a918-ab6077405463", "content-length": "52", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50882024-11-09T02:50:33.787ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
50892024-11-09T02:50:33.787ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50902024-11-09T02:50:33.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "88657247-dbfd-450c-9496-e2938589e331", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50912024-11-09T02:50:33.878ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
50922024-11-09T02:50:33.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50932024-11-09T02:50:33.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c86beb5-f045-40cf-9027-e11177df3128", "content-length": "682", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
50942024-11-09T02:50:33.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50952024-11-09T02:50:33.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50962024-11-09T02:50:33.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50972024-11-09T02:50:33.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50982024-11-09T02:50:33.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50992024-11-09T02:50:33.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51002024-11-09T02:50:33.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51012024-11-09T02:50:33.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51022024-11-09T02:50:33.895ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 727.76667ms iteration = 9 status = {}
51032024-11-09T02:50:33.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 673d24d2-8e7a-4083-9a69-24cf3fd425d2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51042024-11-09T02:50:33.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 673d24d2-8e7a-4083-9a69-24cf3fd425d2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51052024-11-09T02:50:33.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 673d24d2-8e7a-4083-9a69-24cf3fd425d2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51062024-11-09T02:50:34.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 32ca0865-1d7f-4197-900d-725e85683862 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51072024-11-09T02:50:34.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 32ca0865-1d7f-4197-900d-725e85683862 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51082024-11-09T02:50:34.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 32ca0865-1d7f-4197-900d-725e85683862 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51092024-11-09T02:50:35.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 50b82604-5f3f-4824-b65f-2eb575fe43fa roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51102024-11-09T02:50:35.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 50b82604-5f3f-4824-b65f-2eb575fe43fa resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51112024-11-09T02:50:35.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 50b82604-5f3f-4824-b65f-2eb575fe43fa response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51122024-11-09T02:50:36.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3dd7b1e4-6b82-42b8-86e8-2ddcc90b7f73 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51132024-11-09T02:50:36.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3dd7b1e4-6b82-42b8-86e8-2ddcc90b7f73 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51142024-11-09T02:50:36.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3dd7b1e4-6b82-42b8-86e8-2ddcc90b7f73 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51152024-11-09T02:50:37.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 576d9d1d-6bfd-465a-b38d-70e69074082e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51162024-11-09T02:50:37.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 576d9d1d-6bfd-465a-b38d-70e69074082e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51172024-11-09T02:50:37.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 576d9d1d-6bfd-465a-b38d-70e69074082e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51182024-11-09T02:50:38.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1e0cc836-db56-40af-ac88-d940301bbb90 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51192024-11-09T02:50:38.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1e0cc836-db56-40af-ac88-d940301bbb90 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51202024-11-09T02:50:38.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1e0cc836-db56-40af-ac88-d940301bbb90 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51212024-11-09T02:50:39.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ee4c23af-6171-4c77-865f-1f6d1ff41c53 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51222024-11-09T02:50:39.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ee4c23af-6171-4c77-865f-1f6d1ff41c53 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51232024-11-09T02:50:39.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ee4c23af-6171-4c77-865f-1f6d1ff41c53 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51242024-11-09T02:50:40.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9627053-0c98-4fad-b470-612151595150 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51252024-11-09T02:50:40.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9627053-0c98-4fad-b470-612151595150 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51262024-11-09T02:50:40.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9627053-0c98-4fad-b470-612151595150 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51272024-11-09T02:50:41.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04660611-d9ce-4b25-b524-06d2a97aa047 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51282024-11-09T02:50:41.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04660611-d9ce-4b25-b524-06d2a97aa047 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51292024-11-09T02:50:41.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04660611-d9ce-4b25-b524-06d2a97aa047 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51302024-11-09T02:50:42.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 29c181c4-0f3c-4d3b-ba12-2ccdaa6bf8e2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51312024-11-09T02:50:42.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 29c181c4-0f3c-4d3b-ba12-2ccdaa6bf8e2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51322024-11-09T02:50:42.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 29c181c4-0f3c-4d3b-ba12-2ccdaa6bf8e2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51332024-11-09T02:50:43.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
51342024-11-09T02:50:43.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
51352024-11-09T02:50:43.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51362024-11-09T02:50:43.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51372024-11-09T02:50:43.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51382024-11-09T02:50:43.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51392024-11-09T02:50:43.197ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51402024-11-09T02:50:43.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412024-11-09T02:50:43.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51422024-11-09T02:50:43.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.397009ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51432024-11-09T02:50:43.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51442024-11-09T02:50:43.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51452024-11-09T02:50:43.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51462024-11-09T02:50:43.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51472024-11-09T02:50:43.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51482024-11-09T02:50:43.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492024-11-09T02:50:43.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
51502024-11-09T02:50:43.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51512024-11-09T02:50:43.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51522024-11-09T02:50:43.215ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
51532024-11-09T02:50:43.215ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.141054ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
51542024-11-09T02:50:43.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5571e524-96f8-41ac-a81a-5419a815b3e9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51552024-11-09T02:50:43.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5571e524-96f8-41ac-a81a-5419a815b3e9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51562024-11-09T02:50:43.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5571e524-96f8-41ac-a81a-5419a815b3e9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51572024-11-09T02:50:44.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea65c187-1599-4aa0-afd6-32ea3c4a1f94 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51582024-11-09T02:50:44.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea65c187-1599-4aa0-afd6-32ea3c4a1f94 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51592024-11-09T02:50:44.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea65c187-1599-4aa0-afd6-32ea3c4a1f94 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51602024-11-09T02:50:45.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = ff8a3b3b-d93d-493d-8120-b0488c6df262 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
51612024-11-09T02:50:45.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e653e4a1-efdf-41b2-8511-62d13b6c96db roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51622024-11-09T02:50:45.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e653e4a1-efdf-41b2-8511-62d13b6c96db resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51632024-11-09T02:50:45.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e653e4a1-efdf-41b2-8511-62d13b6c96db response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51642024-11-09T02:50:47.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a3d49ae6-08ed-4b49-85db-b6cf6a0582e7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51652024-11-09T02:50:47.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a3d49ae6-08ed-4b49-85db-b6cf6a0582e7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51662024-11-09T02:50:47.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a3d49ae6-08ed-4b49-85db-b6cf6a0582e7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51672024-11-09T02:50:48.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63d8b225-cf24-4dae-8a40-aa631cf125f7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51682024-11-09T02:50:48.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63d8b225-cf24-4dae-8a40-aa631cf125f7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51692024-11-09T02:50:48.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63d8b225-cf24-4dae-8a40-aa631cf125f7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51702024-11-09T02:50:49.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9402731d-3943-41b5-a1b1-6427158ee8d2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51712024-11-09T02:50:49.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9402731d-3943-41b5-a1b1-6427158ee8d2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51722024-11-09T02:50:49.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9402731d-3943-41b5-a1b1-6427158ee8d2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51732024-11-09T02:50:50.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca9df137-cdd2-4784-9791-32bce25ddf67 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51742024-11-09T02:50:50.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca9df137-cdd2-4784-9791-32bce25ddf67 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51752024-11-09T02:50:50.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca9df137-cdd2-4784-9791-32bce25ddf67 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51762024-11-09T02:50:50.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 78e4e666-2a7b-4e2f-9542-772ebf773d70 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
51772024-11-09T02:50:50.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 78e4e666-2a7b-4e2f-9542-772ebf773d70 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
51782024-11-09T02:50:50.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 78e4e666-2a7b-4e2f-9542-772ebf773d70 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
51792024-11-09T02:50:50.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = d9262fe7-1100-4462-bc67-994b23af737d roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
51802024-11-09T02:50:50.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = d9262fe7-1100-4462-bc67-994b23af737d resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
51812024-11-09T02:50:50.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = d9262fe7-1100-4462-bc67-994b23af737d response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
51822024-11-09T02:50:51.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62e7c374-1a73-4023-8193-d68dd61c5598 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51832024-11-09T02:50:51.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62e7c374-1a73-4023-8193-d68dd61c5598 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51842024-11-09T02:50:51.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62e7c374-1a73-4023-8193-d68dd61c5598 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51852024-11-09T02:50:52.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d1acfda-2f22-46f6-8738-56efa15ea3ab roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51862024-11-09T02:50:52.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d1acfda-2f22-46f6-8738-56efa15ea3ab resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51872024-11-09T02:50:52.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d1acfda-2f22-46f6-8738-56efa15ea3ab response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51882024-11-09T02:50:53.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = af22c323-2f30-4f65-88dd-773fdb0c0dbe roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51892024-11-09T02:50:53.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = af22c323-2f30-4f65-88dd-773fdb0c0dbe resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51902024-11-09T02:50:53.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = af22c323-2f30-4f65-88dd-773fdb0c0dbe response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
51912024-11-09T02:50:53.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
51922024-11-09T02:50:53.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
51932024-11-09T02:50:53.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51942024-11-09T02:50:53.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51952024-11-09T02:50:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51962024-11-09T02:50:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51972024-11-09T02:50:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982024-11-09T02:50:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51992024-11-09T02:50:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52002024-11-09T02:50:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52012024-11-09T02:50:53.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52022024-11-09T02:50:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52032024-11-09T02:50:53.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52042024-11-09T02:50:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
52052024-11-09T02:50:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52062024-11-09T02:50:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52072024-11-09T02:50:53.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
52082024-11-09T02:50:53.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.509575ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
52092024-11-09T02:50:53.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52102024-11-09T02:50:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52112024-11-09T02:50:53.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.823418ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52122024-11-09T02:50:54.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8bcc69c8-2fe2-48e6-9d1c-9565391695ba roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52132024-11-09T02:50:54.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8bcc69c8-2fe2-48e6-9d1c-9565391695ba resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52142024-11-09T02:50:54.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8bcc69c8-2fe2-48e6-9d1c-9565391695ba response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52152024-11-09T02:50:55.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5b57cf3b-1538-4bdb-8d1a-f7b53b5e8702 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52162024-11-09T02:50:55.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5b57cf3b-1538-4bdb-8d1a-f7b53b5e8702 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52172024-11-09T02:50:55.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5b57cf3b-1538-4bdb-8d1a-f7b53b5e8702 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52182024-11-09T02:50:56.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ad8932b1-9930-4393-8953-4836474b056c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52192024-11-09T02:50:56.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ad8932b1-9930-4393-8953-4836474b056c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52202024-11-09T02:50:56.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ad8932b1-9930-4393-8953-4836474b056c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52212024-11-09T02:50:57.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b382a615-4de9-4f2b-8f75-6716fbfcd759 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52222024-11-09T02:50:57.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b382a615-4de9-4f2b-8f75-6716fbfcd759 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52232024-11-09T02:50:57.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b382a615-4de9-4f2b-8f75-6716fbfcd759 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52242024-11-09T02:50:58.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 730e061f-1b36-4227-8f59-d959e4511b81 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52252024-11-09T02:50:58.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 730e061f-1b36-4227-8f59-d959e4511b81 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52262024-11-09T02:50:58.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 730e061f-1b36-4227-8f59-d959e4511b81 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52272024-11-09T02:50:59.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93a4ff61-8275-4b13-968f-75ca92d8ff53 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52282024-11-09T02:50:59.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93a4ff61-8275-4b13-968f-75ca92d8ff53 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52292024-11-09T02:50:59.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93a4ff61-8275-4b13-968f-75ca92d8ff53 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52302024-11-09T02:51:00.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 923 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c87863fb-fde2-4393-9ccd-a8fd58b07599 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
52312024-11-09T02:51:00.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdd40705-8985-4268-ae1d-3e054e72c412 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52322024-11-09T02:51:00.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdd40705-8985-4268-ae1d-3e054e72c412 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52332024-11-09T02:51:00.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdd40705-8985-4268-ae1d-3e054e72c412 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52342024-11-09T02:51:01.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf1cdc92-2bf6-4369-a4d4-a8c55e98979b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52352024-11-09T02:51:01.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf1cdc92-2bf6-4369-a4d4-a8c55e98979b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52362024-11-09T02:51:01.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf1cdc92-2bf6-4369-a4d4-a8c55e98979b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52372024-11-09T02:51:02.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b7c84a8-0e34-4107-aa90-f1d88db0f422 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52382024-11-09T02:51:02.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b7c84a8-0e34-4107-aa90-f1d88db0f422 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52392024-11-09T02:51:02.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b7c84a8-0e34-4107-aa90-f1d88db0f422 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
52402024-11-09T02:51:03.167ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
52412024-11-09T02:51:03.168ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52422024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52432024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
52442024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52452024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
52462024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
52472024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52482024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
52492024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52502024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52512024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52522024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
52532024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
52542024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52552024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
52562024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
52572024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52582024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52592024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
52602024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
52612024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52622024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
52632024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52642024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52652024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
52662024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52672024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52682024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52692024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52702024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52712024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52722024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52732024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52742024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52752024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52762024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52772024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52782024-11-09T02:51:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52792024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
52802024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
52812024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.81\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
52822024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.171\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52832024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
52842024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
52852024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.69\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
52862024-11-09T02:51:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.59\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
52872024-11-09T02:51:03.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52882024-11-09T02:51:03.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52892024-11-09T02:51:03.172ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1166, tv_nsec: 511649792 } })
52902024-11-09T02:51:03.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52912024-11-09T02:51:03.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52922024-11-09T02:51:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.807889ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52932024-11-09T02:51:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52942024-11-09T02:51:03.172ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
52952024-11-09T02:51:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52962024-11-09T02:51:03.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52972024-11-09T02:51:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52982024-11-09T02:51:03.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992024-11-09T02:51:03.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53002024-11-09T02:51:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53012024-11-09T02:51:03.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53022024-11-09T02:51:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53032024-11-09T02:51:03.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53042024-11-09T02:51:03.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53052024-11-09T02:51:03.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53062024-11-09T02:51:03.189ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1166, tv_nsec: 528235805 } })
53072024-11-09T02:51:03.189ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
53082024-11-09T02:51:03.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53092024-11-09T02:51:03.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53102024-11-09T02:51:03.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53112024-11-09T02:51:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53122024-11-09T02:51:03.195ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53132024-11-09T02:51:03.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53142024-11-09T02:51:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53152024-11-09T02:51:03.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
53162024-11-09T02:51:03.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53172024-11-09T02:51:03.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182024-11-09T02:51:03.216ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
53192024-11-09T02:51:03.216ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.216486ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
53202024-11-09T02:51:03.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53212024-11-09T02:51:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53222024-11-09T02:51:03.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.116836ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53232024-11-09T02:51:03.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53242024-11-09T02:51:03.227ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53252024-11-09T02:51:03.227ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53262024-11-09T02:51:03.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53272024-11-09T02:51:03.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53282024-11-09T02:51:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53292024-11-09T02:51:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53302024-11-09T02:51:03.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53312024-11-09T02:51:03.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53322024-11-09T02:51:03.230ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53332024-11-09T02:51:03.230ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53342024-11-09T02:51:03.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53352024-11-09T02:51:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53362024-11-09T02:51:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53372024-11-09T02:51:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53382024-11-09T02:51:03.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53392024-11-09T02:51:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53402024-11-09T02:51:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53412024-11-09T02:51:03.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53422024-11-09T02:51:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53432024-11-09T02:51:03.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53442024-11-09T02:51:03.234ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53452024-11-09T02:51:03.234ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94ea0e27-188f-4d89-a6dc-e24817b8b450", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
53462024-11-09T02:51:03.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53472024-11-09T02:51:03.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53482024-11-09T02:51:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53492024-11-09T02:51:03.237ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53502024-11-09T02:51:03.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1166, tv_nsec: 576078524 } })
53512024-11-09T02:51:03.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
53522024-11-09T02:51:03.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.997376ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53532024-11-09T02:51:03.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-11-09T02:51:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53552024-11-09T02:51:03.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53562024-11-09T02:51:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53572024-11-09T02:51:03.241ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53582024-11-09T02:51:03.241ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.174912ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53592024-11-09T02:51:03.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53602024-11-09T02:51:03.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53612024-11-09T02:51:03.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53622024-11-09T02:51:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53632024-11-09T02:51:03.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53642024-11-09T02:51:03.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
53652024-11-09T02:51:03.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53662024-11-09T02:51:03.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53672024-11-09T02:51:03.277ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53682024-11-09T02:51:03.277ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53692024-11-09T02:51:03.277ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.84138ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53702024-11-09T02:51:03.279ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 111.180188ms iteration = 10 status = 0
53712024-11-09T02:51:03.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53722024-11-09T02:51:03.290ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53732024-11-09T02:51:03.290ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "602cd890-07c7-46f0-934a-50c68ad0a7a0", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
53742024-11-09T02:51:03.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53752024-11-09T02:51:03.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53762024-11-09T02:51:03.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53772024-11-09T02:51:03.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53782024-11-09T02:51:03.358ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53792024-11-09T02:51:03.358ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53802024-11-09T02:51:03.359ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f98f4be-131c-4d63-94a4-5b141d8bbdcf", "content-length": "372", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
53812024-11-09T02:51:03.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53822024-11-09T02:51:03.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53832024-11-09T02:51:03.364ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.905889ms iteration = 12 status = {"physical_disks_added":0}
53842024-11-09T02:51:03.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a4537346-7f1e-444e-90e3-02bc1cee3b5c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
53852024-11-09T02:51:03.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a4537346-7f1e-444e-90e3-02bc1cee3b5c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
53862024-11-09T02:51:03.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a4537346-7f1e-444e-90e3-02bc1cee3b5c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
53872024-11-09T02:51:03.379ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53882024-11-09T02:51:03.379ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53892024-11-09T02:51:03.386ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53902024-11-09T02:51:03.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "28bc00e8-09f6-4fbd-87a2-2e45ae14572c", "content-length": "1", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
53912024-11-09T02:51:03.387ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53922024-11-09T02:51:03.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53932024-11-09T02:51:03.389ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 221.597739ms iteration = 10 status = null
53942024-11-09T02:51:03.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53952024-11-09T02:51:03.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53962024-11-09T02:51:03.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972024-11-09T02:51:03.418ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53982024-11-09T02:51:03.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53992024-11-09T02:51:03.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54002024-11-09T02:51:03.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54012024-11-09T02:51:03.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54022024-11-09T02:51:03.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54032024-11-09T02:51:03.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54042024-11-09T02:51:03.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
54052024-11-09T02:51:03.422ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54062024-11-09T02:51:03.422ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a51c6e95-2dd6-4908-90ac-7f09e5ef58fc", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
54072024-11-09T02:51:03.422ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54082024-11-09T02:51:03.424ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
54092024-11-09T02:51:03.426ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.017652ms iteration = 10 status = {}
54102024-11-09T02:51:03.483ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "15068536-582a-4b0e-ab91-c9c4f4820b17", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
54112024-11-09T02:51:03.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54122024-11-09T02:51:03.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54132024-11-09T02:51:03.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54142024-11-09T02:51:03.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54152024-11-09T02:51:03.488ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54162024-11-09T02:51:03.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54172024-11-09T02:51:03.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54182024-11-09T02:51:03.493ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54192024-11-09T02:51:03.493ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54202024-11-09T02:51:03.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54212024-11-09T02:51:03.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54222024-11-09T02:51:03.553ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
54232024-11-09T02:51:03.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54242024-11-09T02:51:03.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54252024-11-09T02:51:03.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54262024-11-09T02:51:03.564ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "24908d53-087d-4f53-8987-ea0a4a74e8ea", "content-length": "134", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
54272024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54282024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
54292024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54302024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54312024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54322024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54332024-11-09T02:51:03.564ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54342024-11-09T02:51:03.565ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54352024-11-09T02:51:03.565ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54362024-11-09T02:51:03.565ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54372024-11-09T02:51:03.565ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
54382024-11-09T02:51:03.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54392024-11-09T02:51:03.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54402024-11-09T02:51:03.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54412024-11-09T02:51:03.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "54253e09-8de0-47bb-8dff-6f2482d130d1", "content-length": "2", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
54422024-11-09T02:51:03.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54432024-11-09T02:51:03.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "208c90d5-a843-4a5b-8b72-45e80746dca9", "content-length": "52", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
54442024-11-09T02:51:03.567ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
54452024-11-09T02:51:03.567ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54462024-11-09T02:51:03.586ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbb2a581-08f4-4384-9b3d-59119babbd6e", "content-length": "691", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
54472024-11-09T02:51:03.586ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54482024-11-09T02:51:03.586ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54492024-11-09T02:51:03.586ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54502024-11-09T02:51:03.586ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "18dcb53e-e3e3-42b5-a01c-b587183638b1", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
54512024-11-09T02:51:03.587ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 419.309915ms iteration = 10 status = {}
54522024-11-09T02:51:03.587ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 419.560181ms iteration = 10 status = {}
54532024-11-09T02:51:03.681ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c6ded998-3568-490e-8761-944fd1d244ee", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
54542024-11-09T02:51:03.681ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
54552024-11-09T02:51:03.681ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54562024-11-09T02:51:03.682ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "087292ad-1aac-478c-88cb-383d7242854d", "content-length": "682", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
54572024-11-09T02:51:03.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54582024-11-09T02:51:03.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54592024-11-09T02:51:03.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54602024-11-09T02:51:03.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54612024-11-09T02:51:03.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54622024-11-09T02:51:03.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54632024-11-09T02:51:03.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54642024-11-09T02:51:03.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54652024-11-09T02:51:03.698ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 529.87554ms iteration = 10 status = {}
54662024-11-09T02:51:03.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ef4816da-ad2b-4e8c-86bf-d5922396d07f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54672024-11-09T02:51:03.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ef4816da-ad2b-4e8c-86bf-d5922396d07f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54682024-11-09T02:51:03.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ef4816da-ad2b-4e8c-86bf-d5922396d07f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54692024-11-09T02:51:04.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fad368d8-c5b7-4f1d-911d-07e30e7a2759 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54702024-11-09T02:51:04.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fad368d8-c5b7-4f1d-911d-07e30e7a2759 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54712024-11-09T02:51:04.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fad368d8-c5b7-4f1d-911d-07e30e7a2759 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54722024-11-09T02:51:05.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f2abdbc3-850e-46b1-a047-86b089ceb833 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54732024-11-09T02:51:05.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f2abdbc3-850e-46b1-a047-86b089ceb833 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54742024-11-09T02:51:05.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f2abdbc3-850e-46b1-a047-86b089ceb833 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54752024-11-09T02:51:06.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95373232-65bf-42c3-8cf1-1e4941d1e85f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54762024-11-09T02:51:06.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95373232-65bf-42c3-8cf1-1e4941d1e85f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54772024-11-09T02:51:06.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95373232-65bf-42c3-8cf1-1e4941d1e85f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54782024-11-09T02:51:07.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2db9ccf9-1cab-4788-a0c7-6d39aca1b8c0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54792024-11-09T02:51:07.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2db9ccf9-1cab-4788-a0c7-6d39aca1b8c0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54802024-11-09T02:51:07.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2db9ccf9-1cab-4788-a0c7-6d39aca1b8c0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54812024-11-09T02:51:08.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3b117cf-e0b6-443a-b468-fb2e46560fed roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54822024-11-09T02:51:08.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3b117cf-e0b6-443a-b468-fb2e46560fed resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54832024-11-09T02:51:08.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3b117cf-e0b6-443a-b468-fb2e46560fed response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54842024-11-09T02:51:09.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eac043d3-b5eb-4a1b-908d-18f5e5af8b17 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54852024-11-09T02:51:09.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eac043d3-b5eb-4a1b-908d-18f5e5af8b17 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54862024-11-09T02:51:09.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eac043d3-b5eb-4a1b-908d-18f5e5af8b17 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54872024-11-09T02:51:10.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9720222-ff6c-415d-b08b-974c26f70104 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54882024-11-09T02:51:10.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9720222-ff6c-415d-b08b-974c26f70104 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54892024-11-09T02:51:10.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9720222-ff6c-415d-b08b-974c26f70104 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54902024-11-09T02:51:11.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 362b6289-2baf-4add-bb76-0db41347e82d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54912024-11-09T02:51:11.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 362b6289-2baf-4add-bb76-0db41347e82d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54922024-11-09T02:51:11.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 362b6289-2baf-4add-bb76-0db41347e82d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54932024-11-09T02:51:12.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3de74001-ade5-47bd-8daa-e3bbc3118773 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54942024-11-09T02:51:12.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3de74001-ade5-47bd-8daa-e3bbc3118773 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54952024-11-09T02:51:12.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3de74001-ade5-47bd-8daa-e3bbc3118773 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
54962024-11-09T02:51:13.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
54972024-11-09T02:51:13.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
54982024-11-09T02:51:13.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992024-11-09T02:51:13.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55002024-11-09T02:51:13.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55012024-11-09T02:51:13.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55022024-11-09T02:51:13.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55032024-11-09T02:51:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55042024-11-09T02:51:13.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55052024-11-09T02:51:13.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.312508ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55062024-11-09T02:51:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55072024-11-09T02:51:13.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55082024-11-09T02:51:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55092024-11-09T02:51:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55102024-11-09T02:51:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55112024-11-09T02:51:13.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55122024-11-09T02:51:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
55132024-11-09T02:51:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55142024-11-09T02:51:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55152024-11-09T02:51:13.188ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
55162024-11-09T02:51:13.188ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.765359ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
55172024-11-09T02:51:13.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 364aab2a-0207-4dd4-aacb-aa0e5c06a8f0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55182024-11-09T02:51:13.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 364aab2a-0207-4dd4-aacb-aa0e5c06a8f0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55192024-11-09T02:51:13.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 364aab2a-0207-4dd4-aacb-aa0e5c06a8f0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55202024-11-09T02:51:14.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9bc0fc31-0012-4462-b24f-2c2aa3e72943 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55212024-11-09T02:51:14.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9bc0fc31-0012-4462-b24f-2c2aa3e72943 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55222024-11-09T02:51:14.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9bc0fc31-0012-4462-b24f-2c2aa3e72943 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55232024-11-09T02:51:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 849 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 2bfc7b22-899b-4aa3-88cc-2ad996637552 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
55242024-11-09T02:51:15.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1393fc2e-6b1a-4cdd-b88d-e6fbc2353dcd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55252024-11-09T02:51:15.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1393fc2e-6b1a-4cdd-b88d-e6fbc2353dcd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55262024-11-09T02:51:15.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1393fc2e-6b1a-4cdd-b88d-e6fbc2353dcd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55272024-11-09T02:51:16.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 995e7171-4169-4256-88d5-61a8b40073da roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55282024-11-09T02:51:16.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 995e7171-4169-4256-88d5-61a8b40073da resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55292024-11-09T02:51:16.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 995e7171-4169-4256-88d5-61a8b40073da response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55302024-11-09T02:51:17.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 85cb5a64-d18a-4ec3-be61-7a2da5b62d21 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55312024-11-09T02:51:17.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 85cb5a64-d18a-4ec3-be61-7a2da5b62d21 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55322024-11-09T02:51:17.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 85cb5a64-d18a-4ec3-be61-7a2da5b62d21 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55332024-11-09T02:51:18.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efb4b1ad-5319-4e10-95b3-6dad63306af0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55342024-11-09T02:51:18.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efb4b1ad-5319-4e10-95b3-6dad63306af0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55352024-11-09T02:51:18.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efb4b1ad-5319-4e10-95b3-6dad63306af0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55362024-11-09T02:51:19.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93ab71d9-4280-4a30-8309-5bf7ffdb6041 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55372024-11-09T02:51:19.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93ab71d9-4280-4a30-8309-5bf7ffdb6041 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55382024-11-09T02:51:19.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93ab71d9-4280-4a30-8309-5bf7ffdb6041 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55392024-11-09T02:51:20.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 0824a87c-dc54-4569-89d6-9aacfde2685b roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
55402024-11-09T02:51:20.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 0824a87c-dc54-4569-89d6-9aacfde2685b resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
55412024-11-09T02:51:20.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 0824a87c-dc54-4569-89d6-9aacfde2685b response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
55422024-11-09T02:51:20.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f534042a-61ef-470e-970f-d951063d149e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
55432024-11-09T02:51:20.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f534042a-61ef-470e-970f-d951063d149e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
55442024-11-09T02:51:20.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f534042a-61ef-470e-970f-d951063d149e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
55452024-11-09T02:51:20.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b2ef262-24bf-4775-8d49-52ca8c989bf2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55462024-11-09T02:51:20.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b2ef262-24bf-4775-8d49-52ca8c989bf2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55472024-11-09T02:51:20.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b2ef262-24bf-4775-8d49-52ca8c989bf2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55482024-11-09T02:51:21.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39405e50-b607-45af-ae57-ea8bc31fd5e5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55492024-11-09T02:51:21.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39405e50-b607-45af-ae57-ea8bc31fd5e5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55502024-11-09T02:51:21.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39405e50-b607-45af-ae57-ea8bc31fd5e5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55512024-11-09T02:51:22.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6aabd6a8-5b42-4116-a744-f152ab9f769d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55522024-11-09T02:51:22.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6aabd6a8-5b42-4116-a744-f152ab9f769d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55532024-11-09T02:51:22.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6aabd6a8-5b42-4116-a744-f152ab9f769d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55542024-11-09T02:51:23.167ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
55552024-11-09T02:51:23.167ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
55562024-11-09T02:51:23.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55572024-11-09T02:51:23.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55582024-11-09T02:51:23.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55592024-11-09T02:51:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55602024-11-09T02:51:23.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55612024-11-09T02:51:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55622024-11-09T02:51:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55632024-11-09T02:51:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55642024-11-09T02:51:23.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55652024-11-09T02:51:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55662024-11-09T02:51:23.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55672024-11-09T02:51:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
55682024-11-09T02:51:23.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55692024-11-09T02:51:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55702024-11-09T02:51:23.185ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
55712024-11-09T02:51:23.185ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.324048ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
55722024-11-09T02:51:23.193ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55732024-11-09T02:51:23.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55742024-11-09T02:51:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.560015ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55752024-11-09T02:51:23.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6cdc64fa-1611-4362-a656-8fc47eec99b2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55762024-11-09T02:51:23.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6cdc64fa-1611-4362-a656-8fc47eec99b2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55772024-11-09T02:51:23.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6cdc64fa-1611-4362-a656-8fc47eec99b2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55782024-11-09T02:51:24.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98e6c9f4-007d-45e0-b8f8-25e41b0cc425 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55792024-11-09T02:51:24.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98e6c9f4-007d-45e0-b8f8-25e41b0cc425 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55802024-11-09T02:51:24.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98e6c9f4-007d-45e0-b8f8-25e41b0cc425 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55812024-11-09T02:51:25.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 96285de3-773c-47b1-a153-fdbcfde718ca roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55822024-11-09T02:51:25.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 96285de3-773c-47b1-a153-fdbcfde718ca resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55832024-11-09T02:51:25.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 96285de3-773c-47b1-a153-fdbcfde718ca response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55842024-11-09T02:51:26.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d8b8e288-6b80-46b9-b941-a570b52ae73e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55852024-11-09T02:51:26.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d8b8e288-6b80-46b9-b941-a570b52ae73e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55862024-11-09T02:51:26.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d8b8e288-6b80-46b9-b941-a570b52ae73e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55872024-11-09T02:51:27.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07e13da5-10d2-4793-a8ff-642415e7acf4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55882024-11-09T02:51:27.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07e13da5-10d2-4793-a8ff-642415e7acf4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55892024-11-09T02:51:27.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07e13da5-10d2-4793-a8ff-642415e7acf4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55902024-11-09T02:51:29.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01ca89a2-278b-4064-88c7-74430c321842 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55912024-11-09T02:51:29.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01ca89a2-278b-4064-88c7-74430c321842 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55922024-11-09T02:51:29.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01ca89a2-278b-4064-88c7-74430c321842 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55932024-11-09T02:51:30.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 29738b1f-6bf1-4118-835b-24b5ead60231 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55942024-11-09T02:51:30.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 29738b1f-6bf1-4118-835b-24b5ead60231 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55952024-11-09T02:51:30.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 29738b1f-6bf1-4118-835b-24b5ead60231 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55962024-11-09T02:51:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 609 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 41be9573-548f-4381-9933-daf713f51345 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
55972024-11-09T02:51:31.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ed519cd9-83ff-48f2-a39c-c965681a189f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55982024-11-09T02:51:31.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ed519cd9-83ff-48f2-a39c-c965681a189f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
55992024-11-09T02:51:31.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ed519cd9-83ff-48f2-a39c-c965681a189f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56002024-11-09T02:51:32.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7ccf5c0-5b36-4d70-8fae-1651c2ea33eb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56012024-11-09T02:51:32.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7ccf5c0-5b36-4d70-8fae-1651c2ea33eb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56022024-11-09T02:51:32.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7ccf5c0-5b36-4d70-8fae-1651c2ea33eb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56032024-11-09T02:51:33.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c446d5c3-b116-4189-9399-e5345f0a2c6d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56042024-11-09T02:51:33.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c446d5c3-b116-4189-9399-e5345f0a2c6d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56052024-11-09T02:51:33.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c446d5c3-b116-4189-9399-e5345f0a2c6d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
56062024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
56072024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56082024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
56092024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56102024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
56112024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56122024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
56132024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
56142024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
56152024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56162024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56172024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56182024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
56192024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
56202024-11-09T02:51:33.168ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:41:33.168542363 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56212024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56222024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56232024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
56242024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56252024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
56262024-11-09T02:51:33.168ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
56272024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56282024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
56292024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56302024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
56312024-11-09T02:51:33.168ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
56322024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.72\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
56332024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
56342024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
56352024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
56362024-11-09T02:51:33.168ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56372024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56382024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
56392024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56402024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56412024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56422024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
56432024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56442024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
56452024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.2\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56462024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
56472024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
56482024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
56492024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.11\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
56502024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56512024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
56522024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56532024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
56542024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
56552024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56562024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
56572024-11-09T02:51:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
56582024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
56592024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.83\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
56602024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
56612024-11-09T02:51:33.169ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
56622024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
56632024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56642024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.67\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56652024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
56662024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
56672024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
56682024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56692024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56702024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56712024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56722024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56732024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56742024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56752024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56762024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56772024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56782024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56792024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56802024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56812024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56822024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56832024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56842024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56852024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56862024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56872024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56882024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56892024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56902024-11-09T02:51:33.169ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 508284563 } })
56912024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56922024-11-09T02:51:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56932024-11-09T02:51:33.169ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 508356234 } })
56942024-11-09T02:51:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
56952024-11-09T02:51:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.249066ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
56962024-11-09T02:51:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
56972024-11-09T02:51:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.767377ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
56982024-11-09T02:51:33.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56992024-11-09T02:51:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57002024-11-09T02:51:33.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57012024-11-09T02:51:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.162746ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57022024-11-09T02:51:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57032024-11-09T02:51:33.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57042024-11-09T02:51:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57052024-11-09T02:51:33.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57062024-11-09T02:51:33.183ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 522434735 } })
57072024-11-09T02:51:33.183ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:41:33.168542363 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57082024-11-09T02:51:33.183ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.197474ms iteration = 6 status = {"expiration":"2024-11-09T02:41:33.168542363Z","pruned":[]}
57092024-11-09T02:51:33.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57102024-11-09T02:51:33.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
57112024-11-09T02:51:33.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57122024-11-09T02:51:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57132024-11-09T02:51:33.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57142024-11-09T02:51:33.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57152024-11-09T02:51:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57162024-11-09T02:51:33.189ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 528357808 } })
57172024-11-09T02:51:33.189ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
57182024-11-09T02:51:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57192024-11-09T02:51:33.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57202024-11-09T02:51:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57212024-11-09T02:51:33.195ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57222024-11-09T02:51:33.196ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.351735ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
57232024-11-09T02:51:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57242024-11-09T02:51:33.199ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57252024-11-09T02:51:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57262024-11-09T02:51:33.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57272024-11-09T02:51:33.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57282024-11-09T02:51:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57292024-11-09T02:51:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57302024-11-09T02:51:33.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57312024-11-09T02:51:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57322024-11-09T02:51:33.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57332024-11-09T02:51:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57342024-11-09T02:51:33.237ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57352024-11-09T02:51:33.237ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57362024-11-09T02:51:33.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57372024-11-09T02:51:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57382024-11-09T02:51:33.240ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57392024-11-09T02:51:33.241ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57402024-11-09T02:51:33.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57412024-11-09T02:51:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57422024-11-09T02:51:33.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57432024-11-09T02:51:33.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57442024-11-09T02:51:33.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57452024-11-09T02:51:33.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57462024-11-09T02:51:33.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57472024-11-09T02:51:33.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57482024-11-09T02:51:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57492024-11-09T02:51:33.257ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
57502024-11-09T02:51:33.257ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
57512024-11-09T02:51:33.257ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.598811ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
57522024-11-09T02:51:33.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57532024-11-09T02:51:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57542024-11-09T02:51:33.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57552024-11-09T02:51:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57562024-11-09T02:51:33.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57572024-11-09T02:51:33.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57582024-11-09T02:51:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57592024-11-09T02:51:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57602024-11-09T02:51:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57612024-11-09T02:51:33.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57622024-11-09T02:51:33.262ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57632024-11-09T02:51:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57642024-11-09T02:51:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57652024-11-09T02:51:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.86217ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57662024-11-09T02:51:33.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57672024-11-09T02:51:33.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682024-11-09T02:51:33.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57692024-11-09T02:51:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57702024-11-09T02:51:33.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57712024-11-09T02:51:33.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57722024-11-09T02:51:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57732024-11-09T02:51:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57742024-11-09T02:51:33.280ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57752024-11-09T02:51:33.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57762024-11-09T02:51:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57772024-11-09T02:51:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57782024-11-09T02:51:33.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57792024-11-09T02:51:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57802024-11-09T02:51:33.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 623493924 } })
57812024-11-09T02:51:33.285ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
57822024-11-09T02:51:33.285ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-11-09T02:51:33.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57842024-11-09T02:51:33.289ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57852024-11-09T02:51:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57862024-11-09T02:51:33.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57872024-11-09T02:51:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57882024-11-09T02:51:33.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57892024-11-09T02:51:33.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57902024-11-09T02:51:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57912024-11-09T02:51:33.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-09T02:51:33.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57932024-11-09T02:51:33.296ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57942024-11-09T02:51:33.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
57952024-11-09T02:51:33.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57962024-11-09T02:51:33.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57972024-11-09T02:51:33.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57982024-11-09T02:51:33.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57992024-11-09T02:51:33.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58002024-11-09T02:51:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58012024-11-09T02:51:33.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58022024-11-09T02:51:33.302ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58032024-11-09T02:51:33.302ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 133.284245ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58042024-11-09T02:51:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58052024-11-09T02:51:33.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58062024-11-09T02:51:33.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58072024-11-09T02:51:33.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58082024-11-09T02:51:33.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58092024-11-09T02:51:33.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58102024-11-09T02:51:33.314ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58112024-11-09T02:51:33.314ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58122024-11-09T02:51:33.314ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.324973ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58132024-11-09T02:51:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58142024-11-09T02:51:33.316ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58152024-11-09T02:51:33.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58162024-11-09T02:51:33.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58172024-11-09T02:51:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58182024-11-09T02:51:33.321ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58192024-11-09T02:51:33.321ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58202024-11-09T02:51:33.321ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58212024-11-09T02:51:33.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58222024-11-09T02:51:33.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58232024-11-09T02:51:33.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58242024-11-09T02:51:33.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
58252024-11-09T02:51:33.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 161.091969ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
58262024-11-09T02:51:33.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58272024-11-09T02:51:33.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58282024-11-09T02:51:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58292024-11-09T02:51:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58302024-11-09T02:51:33.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58312024-11-09T02:51:33.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58322024-11-09T02:51:33.332ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58332024-11-09T02:51:33.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58342024-11-09T02:51:33.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58352024-11-09T02:51:33.338ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58362024-11-09T02:51:33.338ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58372024-11-09T02:51:33.338ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58382024-11-09T02:51:33.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58392024-11-09T02:51:33.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58402024-11-09T02:51:33.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58412024-11-09T02:51:33.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 171.647308ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58422024-11-09T02:51:33.340ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58432024-11-09T02:51:33.341ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58442024-11-09T02:51:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58452024-11-09T02:51:33.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58462024-11-09T02:51:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58472024-11-09T02:51:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58482024-11-09T02:51:33.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58492024-11-09T02:51:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58502024-11-09T02:51:33.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58512024-11-09T02:51:33.346ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58522024-11-09T02:51:33.346ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13216423-61a4-4396-a40e-ff36823c8e4e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:32 GMT"} })
58532024-11-09T02:51:33.346ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58542024-11-09T02:51:33.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58552024-11-09T02:51:33.351ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58562024-11-09T02:51:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58572024-11-09T02:51:33.353ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58582024-11-09T02:51:33.353ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58592024-11-09T02:51:33.353ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 184.410011ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58602024-11-09T02:51:33.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58612024-11-09T02:51:33.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58622024-11-09T02:51:33.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58632024-11-09T02:51:33.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58642024-11-09T02:51:33.361ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58652024-11-09T02:51:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58662024-11-09T02:51:33.361ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672024-11-09T02:51:33.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682024-11-09T02:51:33.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58692024-11-09T02:51:33.364ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58702024-11-09T02:51:33.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58712024-11-09T02:51:33.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58722024-11-09T02:51:33.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58732024-11-09T02:51:33.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58742024-11-09T02:51:33.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58752024-11-09T02:51:33.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58762024-11-09T02:51:33.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58772024-11-09T02:51:33.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58782024-11-09T02:51:33.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58792024-11-09T02:51:33.374ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58802024-11-09T02:51:33.375ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f326e76-5ebf-4093-bb76-1466c4d2b2d1", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
58812024-11-09T02:51:33.375ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58822024-11-09T02:51:33.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58832024-11-09T02:51:33.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58842024-11-09T02:51:33.377ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58852024-11-09T02:51:33.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58862024-11-09T02:51:33.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58872024-11-09T02:51:33.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58882024-11-09T02:51:33.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58892024-11-09T02:51:33.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58902024-11-09T02:51:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58912024-11-09T02:51:33.389ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58922024-11-09T02:51:33.389ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
58932024-11-09T02:51:33.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58942024-11-09T02:51:33.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58952024-11-09T02:51:33.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58962024-11-09T02:51:33.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972024-11-09T02:51:33.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58982024-11-09T02:51:33.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58992024-11-09T02:51:33.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59002024-11-09T02:51:33.401ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59012024-11-09T02:51:33.401ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59022024-11-09T02:51:33.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59032024-11-09T02:51:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59042024-11-09T02:51:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
59052024-11-09T02:51:33.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59062024-11-09T02:51:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59072024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
59082024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59092024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
59102024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 236.216641ms iteration = 6 status = {"generation":2}
59112024-11-09T02:51:33.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59122024-11-09T02:51:33.405ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 236.723852ms iteration = 11 status = 0
59132024-11-09T02:51:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59142024-11-09T02:51:33.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59152024-11-09T02:51:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59162024-11-09T02:51:33.412ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
59172024-11-09T02:51:33.412ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59182024-11-09T02:51:33.412ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
59192024-11-09T02:51:33.412ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 243.478861ms iteration = 6 status = {"generation":1}
59202024-11-09T02:51:33.418ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
59212024-11-09T02:51:33.418ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 250.332032ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59222024-11-09T02:51:33.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59232024-11-09T02:51:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59242024-11-09T02:51:33.425ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
59252024-11-09T02:51:33.425ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 256.866308ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
59262024-11-09T02:51:33.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59272024-11-09T02:51:33.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59282024-11-09T02:51:33.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
59292024-11-09T02:51:33.439ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59302024-11-09T02:51:33.439ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea317f45-642a-4bfb-a84e-3c5b5d36c3a1", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
59312024-11-09T02:51:33.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59322024-11-09T02:51:33.441ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 272.812577ms iteration = 13 status = {"physical_disks_added":0}
59332024-11-09T02:51:33.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
59342024-11-09T02:51:33.534ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 365.761859ms iteration = 11 status = {}
59352024-11-09T02:51:33.541ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
59362024-11-09T02:51:33.552ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59372024-11-09T02:51:33.552ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2da67e24-6d8b-4c25-b2f8-43e63d55d992", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59382024-11-09T02:51:33.552ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59392024-11-09T02:51:33.553ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a8ffcc2e-757b-436f-be2b-02fb03e916cf", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59402024-11-09T02:51:33.553ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59412024-11-09T02:51:33.555ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59422024-11-09T02:51:33.555ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.66584ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59432024-11-09T02:51:33.578ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59442024-11-09T02:51:33.578ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59452024-11-09T02:51:33.578ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5169aa89-dfc1-44a4-802d-f6bc7f7fc284", "content-length": "372", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
59462024-11-09T02:51:33.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59472024-11-09T02:51:33.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59482024-11-09T02:51:33.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59492024-11-09T02:51:33.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59502024-11-09T02:51:33.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59512024-11-09T02:51:33.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59522024-11-09T02:51:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59532024-11-09T02:51:33.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59542024-11-09T02:51:33.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59552024-11-09T02:51:33.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59562024-11-09T02:51:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59572024-11-09T02:51:33.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59582024-11-09T02:51:33.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59592024-11-09T02:51:33.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59602024-11-09T02:51:33.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59612024-11-09T02:51:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59622024-11-09T02:51:33.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59632024-11-09T02:51:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59642024-11-09T02:51:33.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59652024-11-09T02:51:33.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59662024-11-09T02:51:33.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59672024-11-09T02:51:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59682024-11-09T02:51:33.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59692024-11-09T02:51:33.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59702024-11-09T02:51:33.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59712024-11-09T02:51:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59722024-11-09T02:51:33.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59732024-11-09T02:51:33.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59742024-11-09T02:51:33.609ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59752024-11-09T02:51:33.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59762024-11-09T02:51:33.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59772024-11-09T02:51:33.611ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8b872a6-00c5-454d-b427-09d7916dd0c5", "content-length": "1", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
59782024-11-09T02:51:33.613ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59792024-11-09T02:51:33.613ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59802024-11-09T02:51:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59812024-11-09T02:51:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59822024-11-09T02:51:33.615ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59832024-11-09T02:51:33.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59842024-11-09T02:51:33.616ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.560329ms iteration = 11 status = null
59852024-11-09T02:51:33.616ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59862024-11-09T02:51:33.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59872024-11-09T02:51:33.618ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59882024-11-09T02:51:33.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59892024-11-09T02:51:33.622ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59902024-11-09T02:51:33.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59912024-11-09T02:51:33.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59922024-11-09T02:51:33.624ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59932024-11-09T02:51:33.624ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59942024-11-09T02:51:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59952024-11-09T02:51:33.625ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59962024-11-09T02:51:33.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59972024-11-09T02:51:33.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59982024-11-09T02:51:33.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59992024-11-09T02:51:33.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60002024-11-09T02:51:33.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60012024-11-09T02:51:33.639ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
60022024-11-09T02:51:33.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60032024-11-09T02:51:33.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60042024-11-09T02:51:33.640ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60052024-11-09T02:51:33.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
60062024-11-09T02:51:33.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60072024-11-09T02:51:33.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60082024-11-09T02:51:33.647ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
60092024-11-09T02:51:33.648ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
60102024-11-09T02:51:33.648ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
60112024-11-09T02:51:33.652ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60122024-11-09T02:51:33.653ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "25bd7fe7-171b-443c-a26e-dc124e500cf6", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60132024-11-09T02:51:33.653ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60142024-11-09T02:51:33.654ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c6a737cc-b0cf-4b76-8923-15b7414b53a8", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60152024-11-09T02:51:33.654ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60162024-11-09T02:51:33.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "18b44ca3-ff7f-4cf7-a3ff-ebdb00474576", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60172024-11-09T02:51:33.656ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60182024-11-09T02:51:33.658ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60192024-11-09T02:51:33.658ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 490.302832ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60202024-11-09T02:51:33.696ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60212024-11-09T02:51:33.722ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ff7c425d-b7e1-4d9f-b836-45bc39d08478", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60222024-11-09T02:51:33.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60232024-11-09T02:51:33.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60242024-11-09T02:51:33.723ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c47958b1-0eb3-4dbe-9ed2-48ecf9312faa", "content-length": "691", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60252024-11-09T02:51:33.723ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60262024-11-09T02:51:33.723ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60272024-11-09T02:51:33.723ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60282024-11-09T02:51:33.724ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 556.213845ms iteration = 11 status = {}
60292024-11-09T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60302024-11-09T02:51:33.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60312024-11-09T02:51:33.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60322024-11-09T02:51:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60332024-11-09T02:51:33.726ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
60342024-11-09T02:51:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60352024-11-09T02:51:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60362024-11-09T02:51:33.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60372024-11-09T02:51:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60382024-11-09T02:51:33.733ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60392024-11-09T02:51:33.733ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60402024-11-09T02:51:33.733ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7f7c7fdb-b7a3-45da-b9ad-78ea3382fb1c", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60412024-11-09T02:51:33.735ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 567.13572ms iteration = 11 status = {}
60422024-11-09T02:51:33.739ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60432024-11-09T02:51:33.740ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b396539e-97a8-4c5b-a9f6-26d855610009", "content-length": "134", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60442024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60452024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
60462024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60472024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60482024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60492024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60502024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60512024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60522024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60532024-11-09T02:51:33.740ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60542024-11-09T02:51:33.741ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
60552024-11-09T02:51:33.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60562024-11-09T02:51:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60572024-11-09T02:51:33.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60582024-11-09T02:51:33.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "547b16ac-3059-48ae-9c6a-2e459ca44907", "content-length": "2", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60592024-11-09T02:51:33.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60602024-11-09T02:51:33.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba1c5f56-a94e-4b2a-99bb-7e202cf6af61", "content-length": "52", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60612024-11-09T02:51:33.743ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
60622024-11-09T02:51:33.743ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60632024-11-09T02:51:33.767ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
60642024-11-09T02:51:33.767ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
60652024-11-09T02:51:33.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60662024-11-09T02:51:33.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60672024-11-09T02:51:33.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60682024-11-09T02:51:33.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60692024-11-09T02:51:33.772ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60702024-11-09T02:51:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
60712024-11-09T02:51:33.806ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
60722024-11-09T02:51:33.807ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "2e6f0934-9f69-43d7-8541-bfc80d51e6d7", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60732024-11-09T02:51:33.809ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
60742024-11-09T02:51:33.809ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 640.806732ms
60752024-11-09T02:51:33.809ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 640.817993ms iteration = 2 status = {}
60762024-11-09T02:51:33.937ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6cd46efc-2c6b-47ac-9eb8-ed6fb0f5ae65", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60772024-11-09T02:51:33.937ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
60782024-11-09T02:51:33.937ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60792024-11-09T02:51:33.938ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b090ec3-6f23-4e3a-ae0d-bad5790cd18f", "content-length": "682", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
60802024-11-09T02:51:33.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60812024-11-09T02:51:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60822024-11-09T02:51:33.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60832024-11-09T02:51:33.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60842024-11-09T02:51:33.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60852024-11-09T02:51:33.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60862024-11-09T02:51:33.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60872024-11-09T02:51:33.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60882024-11-09T02:51:33.955ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 786.643297ms iteration = 11 status = {}
60892024-11-09T02:51:33.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ccedb742-75a2-4705-acdd-ba930427f558 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60902024-11-09T02:51:33.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ccedb742-75a2-4705-acdd-ba930427f558 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60912024-11-09T02:51:33.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = ccedb742-75a2-4705-acdd-ba930427f558 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60922024-11-09T02:51:34.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cff06c9-b637-40c5-a268-d3064ca74ca7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60932024-11-09T02:51:34.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cff06c9-b637-40c5-a268-d3064ca74ca7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60942024-11-09T02:51:34.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cff06c9-b637-40c5-a268-d3064ca74ca7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60952024-11-09T02:51:35.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 13a7dffe-c435-41c8-9885-abd605c678ff roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60962024-11-09T02:51:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 13a7dffe-c435-41c8-9885-abd605c678ff resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60972024-11-09T02:51:35.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 13a7dffe-c435-41c8-9885-abd605c678ff response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60982024-11-09T02:51:36.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1f95b0e5-4b23-4aa5-a356-d1990a137660 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
60992024-11-09T02:51:36.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1f95b0e5-4b23-4aa5-a356-d1990a137660 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61002024-11-09T02:51:36.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1f95b0e5-4b23-4aa5-a356-d1990a137660 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61012024-11-09T02:51:37.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e5f00e2c-3d45-4ae1-b8bd-2e7714c0505e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61022024-11-09T02:51:37.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e5f00e2c-3d45-4ae1-b8bd-2e7714c0505e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61032024-11-09T02:51:37.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e5f00e2c-3d45-4ae1-b8bd-2e7714c0505e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61042024-11-09T02:51:38.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3a875305-fd55-45b7-a143-de3a928b19a9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61052024-11-09T02:51:38.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3a875305-fd55-45b7-a143-de3a928b19a9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61062024-11-09T02:51:38.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3a875305-fd55-45b7-a143-de3a928b19a9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61072024-11-09T02:51:39.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4c1db59e-881c-47c2-bb25-f3a47224bb0d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61082024-11-09T02:51:39.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4c1db59e-881c-47c2-bb25-f3a47224bb0d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61092024-11-09T02:51:39.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4c1db59e-881c-47c2-bb25-f3a47224bb0d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61102024-11-09T02:51:40.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e31e38a4-e97d-47ba-8a4c-726854854bf4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61112024-11-09T02:51:40.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e31e38a4-e97d-47ba-8a4c-726854854bf4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61122024-11-09T02:51:40.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e31e38a4-e97d-47ba-8a4c-726854854bf4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61132024-11-09T02:51:41.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4a2a3b2-4a81-4c50-85ac-6f6c906252c8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61142024-11-09T02:51:41.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4a2a3b2-4a81-4c50-85ac-6f6c906252c8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61152024-11-09T02:51:41.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4a2a3b2-4a81-4c50-85ac-6f6c906252c8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61162024-11-09T02:51:42.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0572efe6-cccd-4439-8727-b5778463e061 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61172024-11-09T02:51:42.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0572efe6-cccd-4439-8727-b5778463e061 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61182024-11-09T02:51:42.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0572efe6-cccd-4439-8727-b5778463e061 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61192024-11-09T02:51:43.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
61202024-11-09T02:51:43.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
61212024-11-09T02:51:43.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61222024-11-09T02:51:43.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61232024-11-09T02:51:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61242024-11-09T02:51:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61252024-11-09T02:51:43.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61262024-11-09T02:51:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61272024-11-09T02:51:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61282024-11-09T02:51:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61292024-11-09T02:51:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61302024-11-09T02:51:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61312024-11-09T02:51:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61322024-11-09T02:51:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
61332024-11-09T02:51:43.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61342024-11-09T02:51:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61352024-11-09T02:51:43.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
61362024-11-09T02:51:43.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.493425ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
61372024-11-09T02:51:43.197ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61382024-11-09T02:51:43.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61392024-11-09T02:51:43.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.549588ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61402024-11-09T02:51:43.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a848c461-0f83-425b-8f69-5fff655de1a3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61412024-11-09T02:51:43.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a848c461-0f83-425b-8f69-5fff655de1a3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61422024-11-09T02:51:43.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a848c461-0f83-425b-8f69-5fff655de1a3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61432024-11-09T02:51:44.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 554b6ebf-ef0a-4664-87dc-d1edebdaa315 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61442024-11-09T02:51:44.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 554b6ebf-ef0a-4664-87dc-d1edebdaa315 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61452024-11-09T02:51:44.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 554b6ebf-ef0a-4664-87dc-d1edebdaa315 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61462024-11-09T02:51:45.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 802 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = fb738118-b245-47aa-9a76-d2e03fe7f7db response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
61472024-11-09T02:51:45.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 72f76dba-104a-47ad-a3a4-f4be3e4a5964 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61482024-11-09T02:51:45.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 72f76dba-104a-47ad-a3a4-f4be3e4a5964 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61492024-11-09T02:51:45.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 72f76dba-104a-47ad-a3a4-f4be3e4a5964 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61502024-11-09T02:51:46.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2965c87e-f8c4-4c5a-822c-98d3b6ca75e2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61512024-11-09T02:51:46.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2965c87e-f8c4-4c5a-822c-98d3b6ca75e2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61522024-11-09T02:51:46.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2965c87e-f8c4-4c5a-822c-98d3b6ca75e2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61532024-11-09T02:51:47.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 693d7d2a-7461-4a5d-b5d0-66db8ca8f351 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61542024-11-09T02:51:47.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 693d7d2a-7461-4a5d-b5d0-66db8ca8f351 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61552024-11-09T02:51:47.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 693d7d2a-7461-4a5d-b5d0-66db8ca8f351 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61562024-11-09T02:51:48.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4f210b49-9662-4d37-be04-c81f390b5e41 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61572024-11-09T02:51:48.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4f210b49-9662-4d37-be04-c81f390b5e41 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61582024-11-09T02:51:48.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4f210b49-9662-4d37-be04-c81f390b5e41 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61592024-11-09T02:51:49.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03ff8ff8-cb9a-4ca5-baa1-1b8990d99344 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61602024-11-09T02:51:49.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03ff8ff8-cb9a-4ca5-baa1-1b8990d99344 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61612024-11-09T02:51:49.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03ff8ff8-cb9a-4ca5-baa1-1b8990d99344 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61622024-11-09T02:51:50.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 580397bc-d3ac-4730-ba10-c7bfe4b4c6da roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
61632024-11-09T02:51:50.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 580397bc-d3ac-4730-ba10-c7bfe4b4c6da resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
61642024-11-09T02:51:50.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 580397bc-d3ac-4730-ba10-c7bfe4b4c6da response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
61652024-11-09T02:51:50.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f26f9a08-a7d7-49af-b533-40b355db2971 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
61662024-11-09T02:51:50.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f26f9a08-a7d7-49af-b533-40b355db2971 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
61672024-11-09T02:51:50.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = f26f9a08-a7d7-49af-b533-40b355db2971 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
61682024-11-09T02:51:50.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43d9a3be-850d-4d33-b3d4-d0570df9c597 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61692024-11-09T02:51:50.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43d9a3be-850d-4d33-b3d4-d0570df9c597 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61702024-11-09T02:51:50.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43d9a3be-850d-4d33-b3d4-d0570df9c597 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61712024-11-09T02:51:51.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 26dc71d3-661a-4435-b179-8b81191ffb3d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61722024-11-09T02:51:51.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 26dc71d3-661a-4435-b179-8b81191ffb3d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61732024-11-09T02:51:51.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 26dc71d3-661a-4435-b179-8b81191ffb3d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61742024-11-09T02:51:52.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db35456b-9246-4f06-8976-0944d93baf06 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61752024-11-09T02:51:52.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db35456b-9246-4f06-8976-0944d93baf06 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61762024-11-09T02:51:52.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db35456b-9246-4f06-8976-0944d93baf06 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61772024-11-09T02:51:53.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
61782024-11-09T02:51:53.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61792024-11-09T02:51:53.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
61802024-11-09T02:51:53.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61812024-11-09T02:51:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61822024-11-09T02:51:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61832024-11-09T02:51:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61842024-11-09T02:51:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61852024-11-09T02:51:53.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61862024-11-09T02:51:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61872024-11-09T02:51:53.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61882024-11-09T02:51:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61892024-11-09T02:51:53.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61902024-11-09T02:51:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
61912024-11-09T02:51:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61922024-11-09T02:51:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61932024-11-09T02:51:53.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
61942024-11-09T02:51:53.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.325591ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
61952024-11-09T02:51:53.199ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61962024-11-09T02:51:53.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61972024-11-09T02:51:53.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.249739ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61982024-11-09T02:51:53.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 05b4ace7-1e04-4676-a6f4-413426026f67 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
61992024-11-09T02:51:53.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 05b4ace7-1e04-4676-a6f4-413426026f67 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62002024-11-09T02:51:53.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 05b4ace7-1e04-4676-a6f4-413426026f67 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62012024-11-09T02:51:54.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be39d34e-2866-416c-9c39-31757fe63717 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62022024-11-09T02:51:54.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be39d34e-2866-416c-9c39-31757fe63717 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62032024-11-09T02:51:54.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be39d34e-2866-416c-9c39-31757fe63717 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62042024-11-09T02:51:55.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b86eed4-9c12-4a1e-b4c5-d7fc4589212d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62052024-11-09T02:51:55.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b86eed4-9c12-4a1e-b4c5-d7fc4589212d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62062024-11-09T02:51:55.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b86eed4-9c12-4a1e-b4c5-d7fc4589212d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62072024-11-09T02:51:56.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d7b7ce4-bea4-499c-b118-fd9ebe1c43d4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62082024-11-09T02:51:56.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d7b7ce4-bea4-499c-b118-fd9ebe1c43d4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62092024-11-09T02:51:56.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d7b7ce4-bea4-499c-b118-fd9ebe1c43d4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62102024-11-09T02:51:57.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c64c984d-f22d-47b1-ada4-0820c82b136f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62112024-11-09T02:51:57.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c64c984d-f22d-47b1-ada4-0820c82b136f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62122024-11-09T02:51:57.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c64c984d-f22d-47b1-ada4-0820c82b136f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62132024-11-09T02:51:58.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d6aeed3-c3d5-4a4c-b4c7-b3f7ee3a3a77 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62142024-11-09T02:51:58.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d6aeed3-c3d5-4a4c-b4c7-b3f7ee3a3a77 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62152024-11-09T02:51:58.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d6aeed3-c3d5-4a4c-b4c7-b3f7ee3a3a77 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62162024-11-09T02:51:59.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ccb5a83-ce06-4654-bb51-c8d950030d23 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62172024-11-09T02:51:59.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ccb5a83-ce06-4654-bb51-c8d950030d23 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62182024-11-09T02:51:59.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ccb5a83-ce06-4654-bb51-c8d950030d23 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62192024-11-09T02:52:00.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 929 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 486bbca7-5760-4e58-85f6-5a7a4b493053 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
62202024-11-09T02:52:00.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e030db56-17a6-4506-8fc2-c220cbb8bf22 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62212024-11-09T02:52:00.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e030db56-17a6-4506-8fc2-c220cbb8bf22 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62222024-11-09T02:52:00.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e030db56-17a6-4506-8fc2-c220cbb8bf22 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62232024-11-09T02:52:01.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 690d2445-ecaf-4eb2-9a59-30f2c13ec9ad roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62242024-11-09T02:52:01.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 690d2445-ecaf-4eb2-9a59-30f2c13ec9ad resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62252024-11-09T02:52:01.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 690d2445-ecaf-4eb2-9a59-30f2c13ec9ad response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62262024-11-09T02:52:02.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a067d14e-d012-4bcc-b365-c5fdcfe93a70 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62272024-11-09T02:52:02.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a067d14e-d012-4bcc-b365-c5fdcfe93a70 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62282024-11-09T02:52:02.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a067d14e-d012-4bcc-b365-c5fdcfe93a70 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
62292024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
62302024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62312024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
62322024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
62332024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62342024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
62352024-11-09T02:52:03.168ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62362024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62372024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62382024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
62392024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62402024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
62412024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62422024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
62432024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
62442024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62452024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
62462024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62472024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62482024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
62492024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62502024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
62512024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62522024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
62532024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62542024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
62552024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62562024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
62572024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
62582024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.75\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
62592024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
62602024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.461\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62612024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.261\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62622024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
62632024-11-09T02:52:03.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.871\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
62642024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62652024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62662024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62672024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62682024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62692024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62702024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62712024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62722024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62732024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62742024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62752024-11-09T02:52:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62762024-11-09T02:52:03.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62772024-11-09T02:52:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62782024-11-09T02:52:03.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-11-09T02:52:03.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1226, tv_nsec: 512293566 } })
62802024-11-09T02:52:03.173ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.977133ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62812024-11-09T02:52:03.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1226, tv_nsec: 512439149 } })
62822024-11-09T02:52:03.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62832024-11-09T02:52:03.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
62842024-11-09T02:52:03.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
62852024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62862024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62882024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62892024-11-09T02:52:03.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62902024-11-09T02:52:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62912024-11-09T02:52:03.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62922024-11-09T02:52:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62932024-11-09T02:52:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62942024-11-09T02:52:03.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62952024-11-09T02:52:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62962024-11-09T02:52:03.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62972024-11-09T02:52:03.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62982024-11-09T02:52:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62992024-11-09T02:52:03.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63002024-11-09T02:52:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63012024-11-09T02:52:03.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63022024-11-09T02:52:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63032024-11-09T02:52:03.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042024-11-09T02:52:03.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63052024-11-09T02:52:03.189ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1226, tv_nsec: 528491000 } })
63062024-11-09T02:52:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63072024-11-09T02:52:03.190ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
63082024-11-09T02:52:03.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63092024-11-09T02:52:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63102024-11-09T02:52:03.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63112024-11-09T02:52:03.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63122024-11-09T02:52:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63132024-11-09T02:52:03.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63142024-11-09T02:52:03.228ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63152024-11-09T02:52:03.228ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63162024-11-09T02:52:03.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63172024-11-09T02:52:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63182024-11-09T02:52:03.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.414449ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63192024-11-09T02:52:03.230ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63202024-11-09T02:52:03.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.756226ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63212024-11-09T02:52:03.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63222024-11-09T02:52:03.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63232024-11-09T02:52:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63242024-11-09T02:52:03.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63252024-11-09T02:52:03.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63262024-11-09T02:52:03.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272024-11-09T02:52:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63282024-11-09T02:52:03.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63292024-11-09T02:52:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63302024-11-09T02:52:03.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63312024-11-09T02:52:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
63322024-11-09T02:52:03.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63332024-11-09T02:52:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63342024-11-09T02:52:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63352024-11-09T02:52:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63362024-11-09T02:52:03.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
63372024-11-09T02:52:03.248ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63382024-11-09T02:52:03.248ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b1f4c98-a2fa-4370-a022-9f78edc5e8e5", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:02 GMT"} })
63392024-11-09T02:52:03.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63402024-11-09T02:52:03.250ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63412024-11-09T02:52:03.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
63422024-11-09T02:52:03.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.026471ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
63432024-11-09T02:52:03.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63442024-11-09T02:52:03.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63452024-11-09T02:52:03.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63462024-11-09T02:52:03.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63472024-11-09T02:52:03.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-11-09T02:52:03.277ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63492024-11-09T02:52:03.277ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63502024-11-09T02:52:03.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63512024-11-09T02:52:03.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63522024-11-09T02:52:03.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
63532024-11-09T02:52:03.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63542024-11-09T02:52:03.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63552024-11-09T02:52:03.280ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.176858ms iteration = 12 status = 0
63562024-11-09T02:52:03.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.68017ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63572024-11-09T02:52:03.317ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63582024-11-09T02:52:03.317ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63592024-11-09T02:52:03.317ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.916838ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63602024-11-09T02:52:03.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63612024-11-09T02:52:03.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63622024-11-09T02:52:03.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
63632024-11-09T02:52:03.329ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63642024-11-09T02:52:03.329ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fa49416-58eb-43ec-a18c-ecb0f6014e7f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:02 GMT"} })
63652024-11-09T02:52:03.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63662024-11-09T02:52:03.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63672024-11-09T02:52:03.367ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 199.187567ms iteration = 14 status = {"physical_disks_added":0}
63682024-11-09T02:52:03.376ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
63692024-11-09T02:52:03.376ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63702024-11-09T02:52:03.376ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e929660d-3c2e-4e3d-a5e0-0e02aa913f3a", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
63712024-11-09T02:52:03.376ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63722024-11-09T02:52:03.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
63732024-11-09T02:52:03.421ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63742024-11-09T02:52:03.422ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b800e5ca-03ba-4681-806e-77e1c0a8a11c", "content-length": "1", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
63752024-11-09T02:52:03.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63762024-11-09T02:52:03.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63772024-11-09T02:52:03.459ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63782024-11-09T02:52:03.459ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63792024-11-09T02:52:03.461ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.384222ms iteration = 12 status = null
63802024-11-09T02:52:03.486ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 318.185726ms iteration = 12 status = {}
63812024-11-09T02:52:03.545ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "67fdaf9f-b35e-48bd-be39-bea00ea74f2a", "content-length": "372", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
63822024-11-09T02:52:03.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63832024-11-09T02:52:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63842024-11-09T02:52:03.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63852024-11-09T02:52:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63862024-11-09T02:52:03.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63872024-11-09T02:52:03.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63882024-11-09T02:52:03.566ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
63892024-11-09T02:52:03.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63902024-11-09T02:52:03.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63912024-11-09T02:52:03.576ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63922024-11-09T02:52:03.576ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e15ed1-7cbd-4383-aeb2-051f1a7e61db", "content-length": "134", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
63932024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63942024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
63952024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63962024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63972024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63982024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63992024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64002024-11-09T02:52:03.576ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64012024-11-09T02:52:03.577ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64022024-11-09T02:52:03.577ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64032024-11-09T02:52:03.577ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
64042024-11-09T02:52:03.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64052024-11-09T02:52:03.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64062024-11-09T02:52:03.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64072024-11-09T02:52:03.579ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64082024-11-09T02:52:03.579ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8079bb6f-824f-43f5-ad60-ffee8a469b94", "content-length": "2", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64092024-11-09T02:52:03.579ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64102024-11-09T02:52:03.579ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd0e7ab7-2a80-4e4b-b118-c150a086d691", "content-length": "52", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64112024-11-09T02:52:03.579ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
64122024-11-09T02:52:03.579ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64132024-11-09T02:52:03.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64142024-11-09T02:52:03.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64152024-11-09T02:52:03.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64162024-11-09T02:52:03.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172024-11-09T02:52:03.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64182024-11-09T02:52:03.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64192024-11-09T02:52:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64202024-11-09T02:52:03.591ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64212024-11-09T02:52:03.591ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64222024-11-09T02:52:03.672ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64232024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7680075d-86cc-430c-b466-118f96f73bb9", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64242024-11-09T02:52:03.683ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
64252024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64262024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "866ad1bf-4612-458c-918f-cf3699cf3841", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64272024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64282024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64292024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b7dcdf9-344c-487e-ad92-6e9911bdad16", "content-length": "682", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64302024-11-09T02:52:03.683ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd1bc71-bc1b-4f7f-91e9-a3b320c51da0", "content-length": "691", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64312024-11-09T02:52:03.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64322024-11-09T02:52:03.684ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64332024-11-09T02:52:03.684ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64342024-11-09T02:52:03.684ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64352024-11-09T02:52:03.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64362024-11-09T02:52:03.684ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 515.8224ms iteration = 12 status = {}
64372024-11-09T02:52:03.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64382024-11-09T02:52:03.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64392024-11-09T02:52:03.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64402024-11-09T02:52:03.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64412024-11-09T02:52:03.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64422024-11-09T02:52:03.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64432024-11-09T02:52:03.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64442024-11-09T02:52:03.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64452024-11-09T02:52:03.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64462024-11-09T02:52:03.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64472024-11-09T02:52:03.693ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64482024-11-09T02:52:03.694ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64492024-11-09T02:52:03.694ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c3c59d0a-85d4-4f06-ba25-a394b1d5287c", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
64502024-11-09T02:52:03.696ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 527.556432ms iteration = 12 status = {}
64512024-11-09T02:52:03.699ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 531.187408ms iteration = 12 status = {}
64522024-11-09T02:52:03.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 172cb10c-6ed6-47c2-a9ce-d7cc2ea434ae roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64532024-11-09T02:52:03.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 172cb10c-6ed6-47c2-a9ce-d7cc2ea434ae resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64542024-11-09T02:52:03.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 172cb10c-6ed6-47c2-a9ce-d7cc2ea434ae response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64552024-11-09T02:52:04.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 0fe6ffa4-d7cb-4084-b2f2-7714e4d220e5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64562024-11-09T02:52:04.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 0fe6ffa4-d7cb-4084-b2f2-7714e4d220e5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64572024-11-09T02:52:04.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 0fe6ffa4-d7cb-4084-b2f2-7714e4d220e5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64582024-11-09T02:52:04.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eec44fcb-5911-4627-bf49-767227c6b9ac roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64592024-11-09T02:52:04.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eec44fcb-5911-4627-bf49-767227c6b9ac resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64602024-11-09T02:52:04.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eec44fcb-5911-4627-bf49-767227c6b9ac response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64612024-11-09T02:52:05.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = d50d6bd6-dc4b-4cb2-86e0-65c8cde6d48b roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
64622024-11-09T02:52:05.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = d50d6bd6-dc4b-4cb2-86e0-65c8cde6d48b resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
64632024-11-09T02:52:05.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = d50d6bd6-dc4b-4cb2-86e0-65c8cde6d48b response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
64642024-11-09T02:52:05.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 040be284-7c2f-4c9d-ad35-7611ca266c47 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
64652024-11-09T02:52:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 040be284-7c2f-4c9d-ad35-7611ca266c47 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
64662024-11-09T02:52:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 040be284-7c2f-4c9d-ad35-7611ca266c47 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
64672024-11-09T02:52:05.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3b5d655b-1e1f-4b09-a1ec-42329032bbc3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64682024-11-09T02:52:05.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3b5d655b-1e1f-4b09-a1ec-42329032bbc3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64692024-11-09T02:52:05.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3b5d655b-1e1f-4b09-a1ec-42329032bbc3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64702024-11-09T02:52:06.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ec0d42d-413a-452b-9551-677f6a17fa4e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64712024-11-09T02:52:06.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ec0d42d-413a-452b-9551-677f6a17fa4e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64722024-11-09T02:52:06.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ec0d42d-413a-452b-9551-677f6a17fa4e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64732024-11-09T02:52:07.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b804c1f-39b3-400c-853a-47c49b8e00a1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64742024-11-09T02:52:07.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b804c1f-39b3-400c-853a-47c49b8e00a1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64752024-11-09T02:52:07.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b804c1f-39b3-400c-853a-47c49b8e00a1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64762024-11-09T02:52:08.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07061b3c-f913-467a-b825-82d0ce26ee84 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64772024-11-09T02:52:08.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07061b3c-f913-467a-b825-82d0ce26ee84 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64782024-11-09T02:52:08.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 07061b3c-f913-467a-b825-82d0ce26ee84 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64792024-11-09T02:52:09.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c4335e1c-e275-4925-a04e-664ad1beb419 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64802024-11-09T02:52:09.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c4335e1c-e275-4925-a04e-664ad1beb419 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64812024-11-09T02:52:09.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c4335e1c-e275-4925-a04e-664ad1beb419 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64822024-11-09T02:52:10.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 61579860-8813-4b5f-9f78-151322f74494 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64832024-11-09T02:52:10.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 61579860-8813-4b5f-9f78-151322f74494 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64842024-11-09T02:52:10.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 61579860-8813-4b5f-9f78-151322f74494 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64852024-11-09T02:52:11.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39a09e9c-10b4-4a30-b5ae-8df6a923d0ae roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64862024-11-09T02:52:11.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39a09e9c-10b4-4a30-b5ae-8df6a923d0ae resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64872024-11-09T02:52:11.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39a09e9c-10b4-4a30-b5ae-8df6a923d0ae response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64882024-11-09T02:52:12.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 16de17dc-9846-4d74-b9e7-9a3f4a3ed570 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64892024-11-09T02:52:12.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 16de17dc-9846-4d74-b9e7-9a3f4a3ed570 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64902024-11-09T02:52:12.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 16de17dc-9846-4d74-b9e7-9a3f4a3ed570 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
64912024-11-09T02:52:13.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
64922024-11-09T02:52:13.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64932024-11-09T02:52:13.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
64942024-11-09T02:52:13.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64952024-11-09T02:52:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64962024-11-09T02:52:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64972024-11-09T02:52:13.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64982024-11-09T02:52:13.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64992024-11-09T02:52:13.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65002024-11-09T02:52:13.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65012024-11-09T02:52:13.199ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65022024-11-09T02:52:13.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65032024-11-09T02:52:13.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65042024-11-09T02:52:13.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65052024-11-09T02:52:13.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65062024-11-09T02:52:13.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.107364ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65072024-11-09T02:52:13.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
65082024-11-09T02:52:13.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65092024-11-09T02:52:13.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65102024-11-09T02:52:13.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
65112024-11-09T02:52:13.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.154024ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
65122024-11-09T02:52:13.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac7e3d3d-12f2-44dd-836a-6397c503a64d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65132024-11-09T02:52:13.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac7e3d3d-12f2-44dd-836a-6397c503a64d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65142024-11-09T02:52:13.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac7e3d3d-12f2-44dd-836a-6397c503a64d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65152024-11-09T02:52:15.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a2e4d59-ec4f-4b08-bb20-88d81b009afc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65162024-11-09T02:52:15.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a2e4d59-ec4f-4b08-bb20-88d81b009afc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65172024-11-09T02:52:15.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0a2e4d59-ec4f-4b08-bb20-88d81b009afc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65182024-11-09T02:52:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 532 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 46e69724-35cc-44e7-a247-a072729737b8 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
65192024-11-09T02:52:16.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 028aed5a-78e4-4d42-9c45-e58a9fc8b9a2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65202024-11-09T02:52:16.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 028aed5a-78e4-4d42-9c45-e58a9fc8b9a2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65212024-11-09T02:52:16.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 028aed5a-78e4-4d42-9c45-e58a9fc8b9a2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65222024-11-09T02:52:17.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 169a4525-f7cd-4945-b066-099a17d2f898 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65232024-11-09T02:52:17.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 169a4525-f7cd-4945-b066-099a17d2f898 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65242024-11-09T02:52:17.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 169a4525-f7cd-4945-b066-099a17d2f898 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65252024-11-09T02:52:18.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 86bf127d-f671-4773-acd7-863ba117ea58 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65262024-11-09T02:52:18.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 86bf127d-f671-4773-acd7-863ba117ea58 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65272024-11-09T02:52:18.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 86bf127d-f671-4773-acd7-863ba117ea58 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65282024-11-09T02:52:19.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dac1dd0b-87f5-46a4-bf5b-5821970ded55 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65292024-11-09T02:52:19.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dac1dd0b-87f5-46a4-bf5b-5821970ded55 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65302024-11-09T02:52:19.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dac1dd0b-87f5-46a4-bf5b-5821970ded55 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65312024-11-09T02:52:20.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cf0af63-4d59-4895-9fff-7f6f8c564d2e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65322024-11-09T02:52:20.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cf0af63-4d59-4895-9fff-7f6f8c564d2e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65332024-11-09T02:52:20.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cf0af63-4d59-4895-9fff-7f6f8c564d2e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65342024-11-09T02:52:21.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62507757-6cbe-4dc3-be29-587aac80fb28 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65352024-11-09T02:52:21.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62507757-6cbe-4dc3-be29-587aac80fb28 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65362024-11-09T02:52:21.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62507757-6cbe-4dc3-be29-587aac80fb28 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65372024-11-09T02:52:22.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3f9bd523-2c9a-4581-8123-f9a951d3be9a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65382024-11-09T02:52:22.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3f9bd523-2c9a-4581-8123-f9a951d3be9a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65392024-11-09T02:52:22.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3f9bd523-2c9a-4581-8123-f9a951d3be9a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65402024-11-09T02:52:23.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
65412024-11-09T02:52:23.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
65422024-11-09T02:52:23.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65432024-11-09T02:52:23.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65442024-11-09T02:52:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65452024-11-09T02:52:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65462024-11-09T02:52:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65472024-11-09T02:52:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65482024-11-09T02:52:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65492024-11-09T02:52:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65502024-11-09T02:52:23.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65512024-11-09T02:52:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65522024-11-09T02:52:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65532024-11-09T02:52:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
65542024-11-09T02:52:23.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65552024-11-09T02:52:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65562024-11-09T02:52:23.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
65572024-11-09T02:52:23.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.507647ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
65582024-11-09T02:52:23.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b619891-a412-467e-b005-3830d6fe8a76 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65592024-11-09T02:52:23.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b619891-a412-467e-b005-3830d6fe8a76 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65602024-11-09T02:52:23.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65612024-11-09T02:52:23.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65622024-11-09T02:52:23.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b619891-a412-467e-b005-3830d6fe8a76 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65632024-11-09T02:52:23.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.956252ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65642024-11-09T02:52:24.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ab624fc-a3af-4c7a-9044-c938ae27dc1a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65652024-11-09T02:52:24.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ab624fc-a3af-4c7a-9044-c938ae27dc1a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65662024-11-09T02:52:24.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ab624fc-a3af-4c7a-9044-c938ae27dc1a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65672024-11-09T02:52:25.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be7259ab-d1f1-4bc7-8a3c-c1a6c870b1ec roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65682024-11-09T02:52:25.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be7259ab-d1f1-4bc7-8a3c-c1a6c870b1ec resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65692024-11-09T02:52:25.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be7259ab-d1f1-4bc7-8a3c-c1a6c870b1ec response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65702024-11-09T02:52:26.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b541c466-106a-4733-9086-257f41a6bc81 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65712024-11-09T02:52:26.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b541c466-106a-4733-9086-257f41a6bc81 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65722024-11-09T02:52:26.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b541c466-106a-4733-9086-257f41a6bc81 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65732024-11-09T02:52:27.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a0ea9c4c-eb79-435d-b0ab-05085130287d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65742024-11-09T02:52:27.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a0ea9c4c-eb79-435d-b0ab-05085130287d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65752024-11-09T02:52:27.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a0ea9c4c-eb79-435d-b0ab-05085130287d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65762024-11-09T02:52:28.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d7f78f1-a455-4a83-b3c4-7bad117c7247 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65772024-11-09T02:52:28.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d7f78f1-a455-4a83-b3c4-7bad117c7247 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65782024-11-09T02:52:28.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d7f78f1-a455-4a83-b3c4-7bad117c7247 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65792024-11-09T02:52:29.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 83c4be2a-f267-4aa2-8924-27b0c378b432 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65802024-11-09T02:52:29.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 83c4be2a-f267-4aa2-8924-27b0c378b432 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65812024-11-09T02:52:29.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 83c4be2a-f267-4aa2-8924-27b0c378b432 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65822024-11-09T02:52:30.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 540 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 43ee900b-6d55-4704-a666-d1bb86c259a2 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
65832024-11-09T02:52:30.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c6cae719-9ed6-40b0-9b9a-97b53e2d84ab roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65842024-11-09T02:52:30.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c6cae719-9ed6-40b0-9b9a-97b53e2d84ab resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65852024-11-09T02:52:30.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c6cae719-9ed6-40b0-9b9a-97b53e2d84ab response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65862024-11-09T02:52:31.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53082faa-220c-4003-b127-74abb3848d56 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65872024-11-09T02:52:31.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53082faa-220c-4003-b127-74abb3848d56 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65882024-11-09T02:52:31.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53082faa-220c-4003-b127-74abb3848d56 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65892024-11-09T02:52:32.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 088f39be-3a1b-4b16-802b-aa323686b8ab roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65902024-11-09T02:52:32.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 088f39be-3a1b-4b16-802b-aa323686b8ab resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65912024-11-09T02:52:32.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 088f39be-3a1b-4b16-802b-aa323686b8ab response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
65922024-11-09T02:52:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
65932024-11-09T02:52:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
65942024-11-09T02:52:33.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
65952024-11-09T02:52:33.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65962024-11-09T02:52:33.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
65972024-11-09T02:52:33.168ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
65982024-11-09T02:52:33.168ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
65992024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.771\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
66002024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
66012024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
66022024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
66032024-11-09T02:52:33.169ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:42:33.168951963 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66042024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66052024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66062024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66072024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66082024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
66092024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
66102024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66112024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
66122024-11-09T02:52:33.169ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66132024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66142024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
66152024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66162024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
66172024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66182024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
66192024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
66202024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66212024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66222024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
66232024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
66242024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66252024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
66262024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
66272024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66282024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
66292024-11-09T02:52:33.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66302024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66312024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66322024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
66332024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66342024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66352024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
66362024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66372024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66382024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
66392024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66402024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
66412024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66422024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
66432024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66442024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
66452024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.63\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
66462024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
66472024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
66482024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66492024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.32\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
66502024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
66512024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
66522024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66532024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.49\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66542024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
66552024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 29.43\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66562024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66572024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66582024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66592024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66602024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66612024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66622024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66632024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66642024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66652024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66662024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66672024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66682024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66692024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66702024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66712024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66722024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66732024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66742024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66752024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
66762024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66772024-11-09T02:52:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
66782024-11-09T02:52:33.169ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 508329494 } })
66792024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66802024-11-09T02:52:33.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 508352214 } })
66812024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66822024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66832024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66842024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66852024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66862024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66872024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
66882024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.663395ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
66892024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
66902024-11-09T02:52:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.898449ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
66912024-11-09T02:52:33.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66922024-11-09T02:52:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66932024-11-09T02:52:33.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66942024-11-09T02:52:33.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66952024-11-09T02:52:33.181ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.207882ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66962024-11-09T02:52:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66972024-11-09T02:52:33.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66982024-11-09T02:52:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66992024-11-09T02:52:33.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67002024-11-09T02:52:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67012024-11-09T02:52:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67022024-11-09T02:52:33.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67032024-11-09T02:52:33.186ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:42:33.168951963 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67042024-11-09T02:52:33.186ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.561723ms iteration = 7 status = {"expiration":"2024-11-09T02:42:33.168951963Z","pruned":[]}
67052024-11-09T02:52:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67062024-11-09T02:52:33.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67072024-11-09T02:52:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67082024-11-09T02:52:33.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67092024-11-09T02:52:33.194ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 533065255 } })
67102024-11-09T02:52:33.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67112024-11-09T02:52:33.195ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
67122024-11-09T02:52:33.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67132024-11-09T02:52:33.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67142024-11-09T02:52:33.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67152024-11-09T02:52:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67162024-11-09T02:52:33.199ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 538072548 } })
67172024-11-09T02:52:33.200ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
67182024-11-09T02:52:33.202ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 33.077474ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
67192024-11-09T02:52:33.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67202024-11-09T02:52:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67212024-11-09T02:52:33.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67222024-11-09T02:52:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67232024-11-09T02:52:33.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67242024-11-09T02:52:33.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67252024-11-09T02:52:33.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 549826861 } })
67262024-11-09T02:52:33.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67272024-11-09T02:52:33.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
67282024-11-09T02:52:33.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67292024-11-09T02:52:33.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67302024-11-09T02:52:33.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67312024-11-09T02:52:33.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67322024-11-09T02:52:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67332024-11-09T02:52:33.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67342024-11-09T02:52:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67352024-11-09T02:52:33.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67362024-11-09T02:52:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67372024-11-09T02:52:33.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67382024-11-09T02:52:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67392024-11-09T02:52:33.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67402024-11-09T02:52:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67412024-11-09T02:52:33.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422024-11-09T02:52:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67432024-11-09T02:52:33.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67442024-11-09T02:52:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67452024-11-09T02:52:33.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67462024-11-09T02:52:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67472024-11-09T02:52:33.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67482024-11-09T02:52:33.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67492024-11-09T02:52:33.258ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67502024-11-09T02:52:33.258ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67512024-11-09T02:52:33.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67522024-11-09T02:52:33.258ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532024-11-09T02:52:33.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67542024-11-09T02:52:33.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67552024-11-09T02:52:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67562024-11-09T02:52:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67572024-11-09T02:52:33.262ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67582024-11-09T02:52:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67592024-11-09T02:52:33.262ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
67602024-11-09T02:52:33.262ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
67612024-11-09T02:52:33.262ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.553543ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
67622024-11-09T02:52:33.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67632024-11-09T02:52:33.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67642024-11-09T02:52:33.264ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67652024-11-09T02:52:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67662024-11-09T02:52:33.265ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67672024-11-09T02:52:33.265ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67682024-11-09T02:52:33.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67692024-11-09T02:52:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67702024-11-09T02:52:33.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712024-11-09T02:52:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67722024-11-09T02:52:33.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67732024-11-09T02:52:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67742024-11-09T02:52:33.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67752024-11-09T02:52:33.268ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67762024-11-09T02:52:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67772024-11-09T02:52:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67782024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67792024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67802024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67812024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67822024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67832024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67842024-11-09T02:52:33.270ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67852024-11-09T02:52:33.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862024-11-09T02:52:33.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67872024-11-09T02:52:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67882024-11-09T02:52:33.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67892024-11-09T02:52:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67902024-11-09T02:52:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67912024-11-09T02:52:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
67922024-11-09T02:52:33.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67932024-11-09T02:52:33.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67942024-11-09T02:52:33.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-11-09T02:52:33.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67962024-11-09T02:52:33.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.20227ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67972024-11-09T02:52:33.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67982024-11-09T02:52:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67992024-11-09T02:52:33.285ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 116.948628ms iteration = 4 status = {"nsuccess":5}
68002024-11-09T02:52:33.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68012024-11-09T02:52:33.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68022024-11-09T02:52:33.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68032024-11-09T02:52:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68042024-11-09T02:52:33.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68052024-11-09T02:52:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68062024-11-09T02:52:33.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68072024-11-09T02:52:33.296ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
68082024-11-09T02:52:33.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
68092024-11-09T02:52:33.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68102024-11-09T02:52:33.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68112024-11-09T02:52:33.300ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
68122024-11-09T02:52:33.300ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.511288ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
68132024-11-09T02:52:33.303ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.54361ms iteration = 13 status = 0
68142024-11-09T02:52:33.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68152024-11-09T02:52:33.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68162024-11-09T02:52:33.319ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68172024-11-09T02:52:33.319ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68182024-11-09T02:52:33.319ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68192024-11-09T02:52:33.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68202024-11-09T02:52:33.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68212024-11-09T02:52:33.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-11-09T02:52:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68232024-11-09T02:52:33.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68242024-11-09T02:52:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68252024-11-09T02:52:33.327ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68262024-11-09T02:52:33.327ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 158.761121ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68272024-11-09T02:52:33.328ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68282024-11-09T02:52:33.328ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68292024-11-09T02:52:33.328ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 159.402134ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68302024-11-09T02:52:33.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 160.64964ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68312024-11-09T02:52:33.333ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68322024-11-09T02:52:33.333ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68332024-11-09T02:52:33.333ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68342024-11-09T02:52:33.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68352024-11-09T02:52:33.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68362024-11-09T02:52:33.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68372024-11-09T02:52:33.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382024-11-09T02:52:33.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68392024-11-09T02:52:33.337ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68402024-11-09T02:52:33.337ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68412024-11-09T02:52:33.337ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.082674ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68422024-11-09T02:52:33.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68432024-11-09T02:52:33.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
68442024-11-09T02:52:33.341ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68452024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68462024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68472024-11-09T02:52:33.341ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d7fb2ff-2665-44d7-a88f-c1938385b562", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:32 GMT"} })
68482024-11-09T02:52:33.341ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68492024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68502024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68512024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68522024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68532024-11-09T02:52:33.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68542024-11-09T02:52:33.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68552024-11-09T02:52:33.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68562024-11-09T02:52:33.344ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68572024-11-09T02:52:33.344ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68582024-11-09T02:52:33.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68592024-11-09T02:52:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68602024-11-09T02:52:33.350ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68612024-11-09T02:52:33.380ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68622024-11-09T02:52:33.380ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
68632024-11-09T02:52:33.380ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68642024-11-09T02:52:33.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68652024-11-09T02:52:33.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68662024-11-09T02:52:33.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
68672024-11-09T02:52:33.396ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68682024-11-09T02:52:33.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68692024-11-09T02:52:33.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68702024-11-09T02:52:33.396ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc795f99-a394-417b-badb-d8a011005795", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
68712024-11-09T02:52:33.396ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68722024-11-09T02:52:33.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68732024-11-09T02:52:33.398ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
68742024-11-09T02:52:33.400ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
68752024-11-09T02:52:33.400ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 231.605736ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68762024-11-09T02:52:33.402ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 233.154688ms iteration = 15 status = {"physical_disks_added":0}
68772024-11-09T02:52:33.412ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
68782024-11-09T02:52:33.412ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 243.488211ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68792024-11-09T02:52:33.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 082d6aef-7c0b-4463-b411-ce9295438b36 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
68802024-11-09T02:52:33.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 082d6aef-7c0b-4463-b411-ce9295438b36 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
68812024-11-09T02:52:33.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
68822024-11-09T02:52:33.453ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68832024-11-09T02:52:33.453ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb8ee67e-8226-4ccd-82aa-9bbe89c1c9e3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
68842024-11-09T02:52:33.453ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68852024-11-09T02:52:33.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68862024-11-09T02:52:33.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68872024-11-09T02:52:33.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68882024-11-09T02:52:33.472ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68892024-11-09T02:52:33.472ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "02be1518-45ef-422c-92e0-59e129a92243", "content-length": "1", "date": "Sat, 09 Nov 2024 02:52:32 GMT"} })
68902024-11-09T02:52:33.474ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68912024-11-09T02:52:33.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68922024-11-09T02:52:33.510ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68932024-11-09T02:52:33.510ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68942024-11-09T02:52:33.510ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e351283f-2bdd-4254-9d27-69e7c2e4ba6a", "content-length": "372", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
68952024-11-09T02:52:33.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68962024-11-09T02:52:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68972024-11-09T02:52:33.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68982024-11-09T02:52:33.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 082d6aef-7c0b-4463-b411-ce9295438b36 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
68992024-11-09T02:52:33.512ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69002024-11-09T02:52:33.512ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69012024-11-09T02:52:33.512ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
69022024-11-09T02:52:33.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 343.61035ms iteration = 7 status = {"generation":1}
69032024-11-09T02:52:33.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69042024-11-09T02:52:33.513ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 344.779304ms iteration = 13 status = null
69052024-11-09T02:52:33.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69062024-11-09T02:52:33.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69072024-11-09T02:52:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69082024-11-09T02:52:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69092024-11-09T02:52:33.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69102024-11-09T02:52:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69112024-11-09T02:52:33.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69122024-11-09T02:52:33.519ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
69132024-11-09T02:52:33.519ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69142024-11-09T02:52:33.519ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
69152024-11-09T02:52:33.519ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 350.728718ms iteration = 7 status = {"generation":2}
69162024-11-09T02:52:33.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69172024-11-09T02:52:33.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69182024-11-09T02:52:33.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69192024-11-09T02:52:33.533ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69202024-11-09T02:52:33.533ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69212024-11-09T02:52:33.533ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0d9506c8-13e7-4151-ad6a-b3d395708116", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69222024-11-09T02:52:33.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69232024-11-09T02:52:33.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69242024-11-09T02:52:33.535ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69252024-11-09T02:52:33.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69262024-11-09T02:52:33.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69272024-11-09T02:52:33.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69282024-11-09T02:52:33.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69292024-11-09T02:52:33.542ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69302024-11-09T02:52:33.542ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69312024-11-09T02:52:33.542ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a3dd8e27-6d83-4f39-8348-d0f675f15820", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69322024-11-09T02:52:33.543ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 374.672633ms iteration = 13 status = {}
69332024-11-09T02:52:33.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69342024-11-09T02:52:33.575ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c8a41790-20ed-42a1-a470-7f31d0d05741", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69352024-11-09T02:52:33.575ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69362024-11-09T02:52:33.577ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2fc44ed8-57e4-499c-9a5c-7a9584e2443c", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69372024-11-09T02:52:33.577ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69382024-11-09T02:52:33.578ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69392024-11-09T02:52:33.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 409.743388ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69402024-11-09T02:52:33.595ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.236449ms iteration = 13 status = {}
69412024-11-09T02:52:33.654ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69422024-11-09T02:52:33.705ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69432024-11-09T02:52:33.706ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cf0eb4c8-2972-4f8d-9a13-31794bbc6b42", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69442024-11-09T02:52:33.706ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69452024-11-09T02:52:33.708ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a73f256f-4999-4743-9e13-d898c19c998f", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69462024-11-09T02:52:33.708ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69472024-11-09T02:52:33.710ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d36d8af7-c7b9-4ba2-a453-27601dbd8471", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69482024-11-09T02:52:33.710ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69492024-11-09T02:52:33.712ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69502024-11-09T02:52:33.712ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 543.913461ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
69512024-11-09T02:52:33.725ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dba7c0f2-e9f3-442f-b745-156331a6390d", "content-length": "691", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69522024-11-09T02:52:33.725ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69532024-11-09T02:52:33.725ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69542024-11-09T02:52:33.725ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69552024-11-09T02:52:33.726ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 557.568232ms iteration = 13 status = {}
69562024-11-09T02:52:33.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69572024-11-09T02:52:33.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69582024-11-09T02:52:33.767ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
69592024-11-09T02:52:33.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69602024-11-09T02:52:33.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69612024-11-09T02:52:33.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69622024-11-09T02:52:33.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5ae01ff-439b-4ad4-a826-9a8c7f838971", "content-length": "134", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69632024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69642024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
69652024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69662024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69672024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69682024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69692024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69702024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69712024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69722024-11-09T02:52:33.777ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69732024-11-09T02:52:33.778ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
69742024-11-09T02:52:33.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69752024-11-09T02:52:33.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69762024-11-09T02:52:33.780ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69772024-11-09T02:52:33.780ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7349fe39-43c4-48fc-bdb9-a11fa4f2387d", "content-length": "2", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69782024-11-09T02:52:33.780ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69792024-11-09T02:52:33.780ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ec9689e-0d54-436c-b627-1a4feae4e153", "content-length": "52", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69802024-11-09T02:52:33.780ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
69812024-11-09T02:52:33.780ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69822024-11-09T02:52:33.816ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
69832024-11-09T02:52:33.816ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
69842024-11-09T02:52:33.848ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
69852024-11-09T02:52:33.848ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:47594
69862024-11-09T02:52:33.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:47594 req_id = 0d21e121-2632-4f98-b78a-fb90bcdb7a44 roles = RoleSet { roles: {} } uri = /metrics/producers
69872024-11-09T02:52:33.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:47594 req_id = 0d21e121-2632-4f98-b78a-fb90bcdb7a44 resource = Database result = Ok(()) uri = /metrics/producers
69882024-11-09T02:52:33.882ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
69892024-11-09T02:52:33.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33778 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:47594 req_id = 0d21e121-2632-4f98-b78a-fb90bcdb7a44 response_code = 201 uri = /metrics/producers
69902024-11-09T02:52:33.882ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0d21e121-2632-4f98-b78a-fb90bcdb7a44", "content-length": "41", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69912024-11-09T02:52:33.884ZDEBGnexus (producer-registration-task): registered with nexus successfully
69922024-11-09T02:52:33.884ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
69932024-11-09T02:52:33.889ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "84df42ed-f869-4585-ae30-97d990d79799", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69942024-11-09T02:52:33.889ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
69952024-11-09T02:52:33.889ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69962024-11-09T02:52:33.890ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b01aa32-c0cf-4590-bef3-0ecc8760d860", "content-length": "682", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
69972024-11-09T02:52:33.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69982024-11-09T02:52:33.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69992024-11-09T02:52:33.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70002024-11-09T02:52:33.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70012024-11-09T02:52:33.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70022024-11-09T02:52:33.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70032024-11-09T02:52:33.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70042024-11-09T02:52:33.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70052024-11-09T02:52:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 738.446391ms iteration = 13 status = {}
70062024-11-09T02:52:34.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 591d2ad1-e5fd-4c49-977a-503b2529aa41 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70072024-11-09T02:52:34.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 591d2ad1-e5fd-4c49-977a-503b2529aa41 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70082024-11-09T02:52:34.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 591d2ad1-e5fd-4c49-977a-503b2529aa41 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70092024-11-09T02:52:34.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b8f92d79-9daf-4556-8f6c-6f9a63db8d12 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70102024-11-09T02:52:34.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b8f92d79-9daf-4556-8f6c-6f9a63db8d12 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70112024-11-09T02:52:34.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b8f92d79-9daf-4556-8f6c-6f9a63db8d12 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70122024-11-09T02:52:35.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 2892409e-3bc0-4a8c-af0f-5b6079b2faa3 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
70132024-11-09T02:52:35.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 2892409e-3bc0-4a8c-af0f-5b6079b2faa3 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
70142024-11-09T02:52:35.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 2892409e-3bc0-4a8c-af0f-5b6079b2faa3 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
70152024-11-09T02:52:35.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 93a5b9c7-e183-4928-a0cc-9a1658ff4bad roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
70162024-11-09T02:52:35.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 93a5b9c7-e183-4928-a0cc-9a1658ff4bad resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
70172024-11-09T02:52:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61771 req_id = 93a5b9c7-e183-4928-a0cc-9a1658ff4bad response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
70182024-11-09T02:52:35.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 65310e74-ab73-4aca-a692-cc0453f2b072 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70192024-11-09T02:52:35.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 65310e74-ab73-4aca-a692-cc0453f2b072 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70202024-11-09T02:52:35.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 65310e74-ab73-4aca-a692-cc0453f2b072 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70212024-11-09T02:52:36.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03aa40e7-7e5f-4df8-8094-2eb020a6da74 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70222024-11-09T02:52:36.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03aa40e7-7e5f-4df8-8094-2eb020a6da74 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70232024-11-09T02:52:36.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03aa40e7-7e5f-4df8-8094-2eb020a6da74 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70242024-11-09T02:52:37.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 282d9f0c-9930-496f-9a4d-406942b4815c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70252024-11-09T02:52:37.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 282d9f0c-9930-496f-9a4d-406942b4815c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70262024-11-09T02:52:37.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 282d9f0c-9930-496f-9a4d-406942b4815c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70272024-11-09T02:52:38.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b965ae69-fb96-4227-a652-5f49db7254ee roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70282024-11-09T02:52:38.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b965ae69-fb96-4227-a652-5f49db7254ee resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70292024-11-09T02:52:38.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b965ae69-fb96-4227-a652-5f49db7254ee response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70302024-11-09T02:52:39.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c0f1e410-400d-43f8-b789-a881d9f4c497 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70312024-11-09T02:52:39.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c0f1e410-400d-43f8-b789-a881d9f4c497 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70322024-11-09T02:52:39.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c0f1e410-400d-43f8-b789-a881d9f4c497 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70332024-11-09T02:52:40.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dbd50a14-71b2-4c74-9e47-aff2f4ef5d1d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70342024-11-09T02:52:40.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dbd50a14-71b2-4c74-9e47-aff2f4ef5d1d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70352024-11-09T02:52:40.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dbd50a14-71b2-4c74-9e47-aff2f4ef5d1d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70362024-11-09T02:52:41.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a11cdf75-9e90-433e-b1d6-fa28621ad105 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70372024-11-09T02:52:41.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a11cdf75-9e90-433e-b1d6-fa28621ad105 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70382024-11-09T02:52:41.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a11cdf75-9e90-433e-b1d6-fa28621ad105 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70392024-11-09T02:52:42.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be77697c-927e-44b3-b0d8-62d898f92b83 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70402024-11-09T02:52:42.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be77697c-927e-44b3-b0d8-62d898f92b83 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70412024-11-09T02:52:42.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be77697c-927e-44b3-b0d8-62d898f92b83 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70422024-11-09T02:52:43.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
70432024-11-09T02:52:43.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
70442024-11-09T02:52:43.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70452024-11-09T02:52:43.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70462024-11-09T02:52:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70472024-11-09T02:52:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70482024-11-09T02:52:43.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70492024-11-09T02:52:43.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70502024-11-09T02:52:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70512024-11-09T02:52:43.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.508464ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70522024-11-09T02:52:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70532024-11-09T02:52:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70542024-11-09T02:52:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70552024-11-09T02:52:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70562024-11-09T02:52:43.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70572024-11-09T02:52:43.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70582024-11-09T02:52:43.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
70592024-11-09T02:52:43.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70602024-11-09T02:52:43.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70612024-11-09T02:52:43.187ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
70622024-11-09T02:52:43.187ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.745287ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
70632024-11-09T02:52:43.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fe77435b-fd1c-4c2a-a712-1580035f5c31 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70642024-11-09T02:52:43.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fe77435b-fd1c-4c2a-a712-1580035f5c31 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70652024-11-09T02:52:43.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fe77435b-fd1c-4c2a-a712-1580035f5c31 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70662024-11-09T02:52:44.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6c7f414a-ced9-4189-947e-2325ce1bab4e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70672024-11-09T02:52:44.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6c7f414a-ced9-4189-947e-2325ce1bab4e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70682024-11-09T02:52:44.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6c7f414a-ced9-4189-947e-2325ce1bab4e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70692024-11-09T02:52:45.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 587 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 233e63ea-d452-488b-84bf-1b1c0f3192eb response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
70702024-11-09T02:52:45.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0216c950-14f3-4e06-b941-f34e0f32c0c8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70712024-11-09T02:52:45.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0216c950-14f3-4e06-b941-f34e0f32c0c8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70722024-11-09T02:52:45.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0216c950-14f3-4e06-b941-f34e0f32c0c8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70732024-11-09T02:52:46.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 579106d2-8609-432a-acad-3db2baedb587 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70742024-11-09T02:52:46.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 579106d2-8609-432a-acad-3db2baedb587 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70752024-11-09T02:52:46.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 579106d2-8609-432a-acad-3db2baedb587 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70762024-11-09T02:52:47.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 951f615d-c623-4a6f-87cf-db899b490cce roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70772024-11-09T02:52:47.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 951f615d-c623-4a6f-87cf-db899b490cce resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70782024-11-09T02:52:47.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 951f615d-c623-4a6f-87cf-db899b490cce response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70792024-11-09T02:52:48.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 69af3dc1-fb72-448a-b481-0765c2a98da3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70802024-11-09T02:52:48.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 69af3dc1-fb72-448a-b481-0765c2a98da3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70812024-11-09T02:52:48.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 69af3dc1-fb72-448a-b481-0765c2a98da3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70822024-11-09T02:52:49.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20700662-0401-46ca-924b-062b2f7d2889 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70832024-11-09T02:52:49.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20700662-0401-46ca-924b-062b2f7d2889 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70842024-11-09T02:52:49.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20700662-0401-46ca-924b-062b2f7d2889 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70852024-11-09T02:52:50.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c049f09c-15c1-4117-83b0-6631a5ffc428 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70862024-11-09T02:52:50.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c049f09c-15c1-4117-83b0-6631a5ffc428 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70872024-11-09T02:52:50.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c049f09c-15c1-4117-83b0-6631a5ffc428 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70882024-11-09T02:52:51.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 37c04d89-92e9-448d-84d8-aafdf45f7d36 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70892024-11-09T02:52:51.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 37c04d89-92e9-448d-84d8-aafdf45f7d36 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70902024-11-09T02:52:51.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 37c04d89-92e9-448d-84d8-aafdf45f7d36 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70912024-11-09T02:52:52.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0c639b89-c645-4d05-b58d-26f7ece9b8bb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70922024-11-09T02:52:52.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0c639b89-c645-4d05-b58d-26f7ece9b8bb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70932024-11-09T02:52:52.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0c639b89-c645-4d05-b58d-26f7ece9b8bb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
70942024-11-09T02:52:53.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
70952024-11-09T02:52:53.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
70962024-11-09T02:52:53.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70972024-11-09T02:52:53.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70982024-11-09T02:52:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70992024-11-09T02:52:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71002024-11-09T02:52:53.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71012024-11-09T02:52:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71022024-11-09T02:52:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71032024-11-09T02:52:53.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.470332ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71042024-11-09T02:52:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71052024-11-09T02:52:53.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71062024-11-09T02:52:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71072024-11-09T02:52:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71082024-11-09T02:52:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71092024-11-09T02:52:53.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102024-11-09T02:52:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
71112024-11-09T02:52:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71122024-11-09T02:52:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71132024-11-09T02:52:53.187ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
71142024-11-09T02:52:53.187ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.495282ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
71152024-11-09T02:52:53.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 49ca0b6e-cabc-4e64-ad17-dc35567047f8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71162024-11-09T02:52:53.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 49ca0b6e-cabc-4e64-ad17-dc35567047f8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71172024-11-09T02:52:53.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 49ca0b6e-cabc-4e64-ad17-dc35567047f8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71182024-11-09T02:52:54.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b28fd18-dc5a-417e-8192-8a5c2bc5a7d3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71192024-11-09T02:52:54.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b28fd18-dc5a-417e-8192-8a5c2bc5a7d3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71202024-11-09T02:52:54.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b28fd18-dc5a-417e-8192-8a5c2bc5a7d3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71212024-11-09T02:52:56.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b9a02ff7-3bd8-4500-bd22-45bc89904531 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71222024-11-09T02:52:56.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b9a02ff7-3bd8-4500-bd22-45bc89904531 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71232024-11-09T02:52:56.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b9a02ff7-3bd8-4500-bd22-45bc89904531 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71242024-11-09T02:52:57.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 007b715e-4397-4bb2-ad08-0e3bb8b2a771 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71252024-11-09T02:52:57.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 007b715e-4397-4bb2-ad08-0e3bb8b2a771 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71262024-11-09T02:52:57.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 007b715e-4397-4bb2-ad08-0e3bb8b2a771 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71272024-11-09T02:52:58.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ca3947f-66ab-449d-ab0a-342879c7995b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71282024-11-09T02:52:58.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ca3947f-66ab-449d-ab0a-342879c7995b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71292024-11-09T02:52:58.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ca3947f-66ab-449d-ab0a-342879c7995b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71302024-11-09T02:52:59.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9524347c-4482-419d-a728-f7da8dac026f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71312024-11-09T02:52:59.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9524347c-4482-419d-a728-f7da8dac026f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71322024-11-09T02:52:59.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9524347c-4482-419d-a728-f7da8dac026f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71332024-11-09T02:53:00.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a8e0e48-3f96-44c1-b5b7-62ee732ef449 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71342024-11-09T02:53:00.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a8e0e48-3f96-44c1-b5b7-62ee732ef449 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71352024-11-09T02:53:00.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a8e0e48-3f96-44c1-b5b7-62ee732ef449 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71362024-11-09T02:53:00.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 569 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c8c93e3f-e90d-43dd-bc04-31775925f622 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
71372024-11-09T02:53:01.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9241a64c-5257-47b5-b7f8-62b8de21bf92 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71382024-11-09T02:53:01.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9241a64c-5257-47b5-b7f8-62b8de21bf92 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71392024-11-09T02:53:01.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9241a64c-5257-47b5-b7f8-62b8de21bf92 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71402024-11-09T02:53:02.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 37218a2b-3072-4813-96cd-bb845cb6f34e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71412024-11-09T02:53:02.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 37218a2b-3072-4813-96cd-bb845cb6f34e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71422024-11-09T02:53:02.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 37218a2b-3072-4813-96cd-bb845cb6f34e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71432024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
71442024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71452024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
71462024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71472024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71482024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
71492024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
71502024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71512024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71522024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
71532024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
71542024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71552024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71562024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
71572024-11-09T02:53:03.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71582024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
71592024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71602024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
71612024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71622024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71632024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
71642024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
71652024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71662024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
71672024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71682024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
71692024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71702024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
71712024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
71722024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.85\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71732024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.84\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
71742024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
71752024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.82\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
71762024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
71772024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.7\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
71782024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71792024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71802024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71812024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71822024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71832024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71842024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71852024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71862024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71872024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71882024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71892024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71902024-11-09T02:53:03.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71912024-11-09T02:53:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71922024-11-09T02:53:03.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71932024-11-09T02:53:03.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.990763ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71942024-11-09T02:53:03.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-11-09T02:53:03.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71962024-11-09T02:53:03.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71972024-11-09T02:53:03.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d4490534-012b-4b1c-8aa9-5702875aa35f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71982024-11-09T02:53:03.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d4490534-012b-4b1c-8aa9-5702875aa35f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
71992024-11-09T02:53:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72002024-11-09T02:53:03.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72012024-11-09T02:53:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72022024-11-09T02:53:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72032024-11-09T02:53:03.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72042024-11-09T02:53:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72052024-11-09T02:53:03.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72062024-11-09T02:53:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72072024-11-09T02:53:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72082024-11-09T02:53:03.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72092024-11-09T02:53:03.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72102024-11-09T02:53:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72112024-11-09T02:53:03.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72122024-11-09T02:53:03.181ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 519499164 } })
72132024-11-09T02:53:03.181ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
72142024-11-09T02:53:03.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d4490534-012b-4b1c-8aa9-5702875aa35f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
72152024-11-09T02:53:03.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.296485ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72162024-11-09T02:53:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72172024-11-09T02:53:03.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72182024-11-09T02:53:03.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 520594097 } })
72192024-11-09T02:53:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72202024-11-09T02:53:03.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
72212024-11-09T02:53:03.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72222024-11-09T02:53:03.195ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72232024-11-09T02:53:03.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72242024-11-09T02:53:03.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72252024-11-09T02:53:03.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72262024-11-09T02:53:03.196ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 534666898 } })
72272024-11-09T02:53:03.196ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
72282024-11-09T02:53:03.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72292024-11-09T02:53:03.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72302024-11-09T02:53:03.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72312024-11-09T02:53:03.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72322024-11-09T02:53:03.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72332024-11-09T02:53:03.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72342024-11-09T02:53:03.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72352024-11-09T02:53:03.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72362024-11-09T02:53:03.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
72372024-11-09T02:53:03.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72382024-11-09T02:53:03.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72392024-11-09T02:53:03.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72402024-11-09T02:53:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72412024-11-09T02:53:03.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72422024-11-09T02:53:03.219ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
72432024-11-09T02:53:03.219ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.130576ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
72442024-11-09T02:53:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72452024-11-09T02:53:03.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72462024-11-09T02:53:03.221ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72472024-11-09T02:53:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72482024-11-09T02:53:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72492024-11-09T02:53:03.222ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72502024-11-09T02:53:03.222ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72512024-11-09T02:53:03.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72522024-11-09T02:53:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72532024-11-09T02:53:03.229ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72542024-11-09T02:53:03.229ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72552024-11-09T02:53:03.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72562024-11-09T02:53:03.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72572024-11-09T02:53:03.230ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72582024-11-09T02:53:03.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.737656ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72592024-11-09T02:53:03.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72602024-11-09T02:53:03.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72612024-11-09T02:53:03.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72622024-11-09T02:53:03.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72632024-11-09T02:53:03.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72642024-11-09T02:53:03.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72652024-11-09T02:53:03.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.331266ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72662024-11-09T02:53:03.273ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72672024-11-09T02:53:03.273ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72682024-11-09T02:53:03.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.732674ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72692024-11-09T02:53:03.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
72702024-11-09T02:53:03.275ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72712024-11-09T02:53:03.275ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22c54b28-6a8f-4d34-a24e-272a684a8750", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
72722024-11-09T02:53:03.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72732024-11-09T02:53:03.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72742024-11-09T02:53:03.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
72752024-11-09T02:53:03.280ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72762024-11-09T02:53:03.280ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd3f4f2-ba1a-4351-bf29-e8a15e720ff5", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
72772024-11-09T02:53:03.280ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72782024-11-09T02:53:03.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72792024-11-09T02:53:03.294ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
72802024-11-09T02:53:03.294ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72812024-11-09T02:53:03.294ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f33c16c4-8f8e-40fd-8ed8-827af69d892f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
72822024-11-09T02:53:03.294ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72832024-11-09T02:53:03.296ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
72842024-11-09T02:53:03.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72852024-11-09T02:53:03.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
72862024-11-09T02:53:03.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72872024-11-09T02:53:03.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72882024-11-09T02:53:03.309ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 140.460963ms iteration = 14 status = 0
72892024-11-09T02:53:03.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.020497ms iteration = 16 status = {"physical_disks_added":0}
72902024-11-09T02:53:03.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72912024-11-09T02:53:03.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72922024-11-09T02:53:03.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72932024-11-09T02:53:03.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72942024-11-09T02:53:03.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72952024-11-09T02:53:03.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72962024-11-09T02:53:03.386ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72972024-11-09T02:53:03.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "495bb733-dbda-47f7-b892-aeda1d742293", "content-length": "1", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
72982024-11-09T02:53:03.387ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72992024-11-09T02:53:03.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73002024-11-09T02:53:03.389ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.848203ms iteration = 14 status = {}
73012024-11-09T02:53:03.389ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73022024-11-09T02:53:03.389ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73032024-11-09T02:53:03.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73042024-11-09T02:53:03.392ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 223.182652ms iteration = 14 status = null
73052024-11-09T02:53:03.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73062024-11-09T02:53:03.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73072024-11-09T02:53:03.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73082024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5c41495-39f7-4966-9bb7-d48b9f2bd7fe", "content-length": "372", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
73092024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73102024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73112024-11-09T02:53:03.419ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73122024-11-09T02:53:03.419ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73132024-11-09T02:53:03.419ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bb54c226-2c55-4f63-b95b-5a807b6ef3b4", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
73142024-11-09T02:53:03.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73152024-11-09T02:53:03.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73162024-11-09T02:53:03.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73172024-11-09T02:53:03.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73182024-11-09T02:53:03.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73192024-11-09T02:53:03.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73202024-11-09T02:53:03.431ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73212024-11-09T02:53:03.431ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73222024-11-09T02:53:03.431ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a4d71d5-f683-446a-8ece-207a701bc94e", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
73232024-11-09T02:53:03.433ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 264.273391ms iteration = 14 status = {}
73242024-11-09T02:53:03.459ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73252024-11-09T02:53:03.460ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85a09a2a-c51d-4a14-975d-9c37d6cd6b30", "content-length": "691", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
73262024-11-09T02:53:03.460ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
73272024-11-09T02:53:03.460ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73282024-11-09T02:53:03.460ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73292024-11-09T02:53:03.462ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 293.203659ms iteration = 14 status = {}
73302024-11-09T02:53:03.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73312024-11-09T02:53:03.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73322024-11-09T02:53:03.493ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
73332024-11-09T02:53:03.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73342024-11-09T02:53:03.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73352024-11-09T02:53:03.503ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73362024-11-09T02:53:03.503ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "14067788-3db1-4cf4-ad95-f05bdf317be4", "content-length": "134", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
73372024-11-09T02:53:03.503ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73382024-11-09T02:53:03.503ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
73392024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73402024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73412024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73422024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73432024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73442024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73452024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73462024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73472024-11-09T02:53:03.504ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
73482024-11-09T02:53:03.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73492024-11-09T02:53:03.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73502024-11-09T02:53:03.506ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73512024-11-09T02:53:03.506ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f178545-04f0-4983-bba4-9ad599a0aa55", "content-length": "2", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
73522024-11-09T02:53:03.506ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73532024-11-09T02:53:03.506ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "733009fe-0cd7-4e0d-a414-7dbfc9ed90cb", "content-length": "52", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
73542024-11-09T02:53:03.506ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
73552024-11-09T02:53:03.506ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73562024-11-09T02:53:03.644ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6aa9232-d101-4d61-9467-60b48ebc51a0", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
73572024-11-09T02:53:03.644ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
73582024-11-09T02:53:03.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73592024-11-09T02:53:03.644ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9aaa917-3b5d-419f-a35b-070100028db9", "content-length": "682", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
73602024-11-09T02:53:03.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73612024-11-09T02:53:03.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73622024-11-09T02:53:03.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73632024-11-09T02:53:03.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73642024-11-09T02:53:03.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73652024-11-09T02:53:03.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73662024-11-09T02:53:03.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73672024-11-09T02:53:03.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73682024-11-09T02:53:03.660ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.536698ms iteration = 14 status = {}
73692024-11-09T02:53:04.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 05113cef-9268-49f9-8d61-2152e2d288a0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73702024-11-09T02:53:04.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 05113cef-9268-49f9-8d61-2152e2d288a0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73712024-11-09T02:53:04.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 05113cef-9268-49f9-8d61-2152e2d288a0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73722024-11-09T02:53:04.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7eb51e8f-55c1-421d-8dfb-41bb9d22dfaf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73732024-11-09T02:53:04.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7eb51e8f-55c1-421d-8dfb-41bb9d22dfaf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73742024-11-09T02:53:04.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7eb51e8f-55c1-421d-8dfb-41bb9d22dfaf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73752024-11-09T02:53:05.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 45c624a7-9a29-40fa-a064-f4cd88924500 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73762024-11-09T02:53:05.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 45c624a7-9a29-40fa-a064-f4cd88924500 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73772024-11-09T02:53:05.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 45c624a7-9a29-40fa-a064-f4cd88924500 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73782024-11-09T02:53:06.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 11d33238-a9b0-412a-9fae-bc6c55e2e696 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73792024-11-09T02:53:06.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 11d33238-a9b0-412a-9fae-bc6c55e2e696 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73802024-11-09T02:53:06.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 11d33238-a9b0-412a-9fae-bc6c55e2e696 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73812024-11-09T02:53:07.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 52d80677-3e05-488a-ae85-c422be91fd7c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73822024-11-09T02:53:07.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 52d80677-3e05-488a-ae85-c422be91fd7c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73832024-11-09T02:53:07.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 52d80677-3e05-488a-ae85-c422be91fd7c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73842024-11-09T02:53:08.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43262b7b-9b34-45cc-a0b4-83ad62bd2310 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73852024-11-09T02:53:08.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43262b7b-9b34-45cc-a0b4-83ad62bd2310 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73862024-11-09T02:53:08.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43262b7b-9b34-45cc-a0b4-83ad62bd2310 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73872024-11-09T02:53:09.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0165b8af-9819-4abf-bbef-303fccb22c64 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73882024-11-09T02:53:09.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0165b8af-9819-4abf-bbef-303fccb22c64 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73892024-11-09T02:53:09.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0165b8af-9819-4abf-bbef-303fccb22c64 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73902024-11-09T02:53:10.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6318e0a-b12c-43bd-b09e-32769583ed51 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73912024-11-09T02:53:10.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6318e0a-b12c-43bd-b09e-32769583ed51 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73922024-11-09T02:53:10.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6318e0a-b12c-43bd-b09e-32769583ed51 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73932024-11-09T02:53:11.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e4fe3dba-db53-41bb-a937-f814aa696302 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73942024-11-09T02:53:11.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e4fe3dba-db53-41bb-a937-f814aa696302 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73952024-11-09T02:53:11.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e4fe3dba-db53-41bb-a937-f814aa696302 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73962024-11-09T02:53:12.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fcbf82f-50d4-4504-8d06-f35a48288856 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73972024-11-09T02:53:12.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fcbf82f-50d4-4504-8d06-f35a48288856 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73982024-11-09T02:53:12.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fcbf82f-50d4-4504-8d06-f35a48288856 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
73992024-11-09T02:53:13.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
74002024-11-09T02:53:13.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
74012024-11-09T02:53:13.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74022024-11-09T02:53:13.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74032024-11-09T02:53:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74042024-11-09T02:53:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74052024-11-09T02:53:13.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74062024-11-09T02:53:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74072024-11-09T02:53:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74082024-11-09T02:53:13.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.326239ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74092024-11-09T02:53:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74102024-11-09T02:53:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74112024-11-09T02:53:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74122024-11-09T02:53:13.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74132024-11-09T02:53:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74142024-11-09T02:53:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74152024-11-09T02:53:13.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
74162024-11-09T02:53:13.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74172024-11-09T02:53:13.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74182024-11-09T02:53:13.186ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
74192024-11-09T02:53:13.186ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.716535ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
74202024-11-09T02:53:13.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb79a72d-3e32-4cc2-a306-8549815daa18 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74212024-11-09T02:53:13.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb79a72d-3e32-4cc2-a306-8549815daa18 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74222024-11-09T02:53:13.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb79a72d-3e32-4cc2-a306-8549815daa18 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74232024-11-09T02:53:14.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84512599-9694-4b25-80fa-24cabd91c764 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74242024-11-09T02:53:14.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84512599-9694-4b25-80fa-24cabd91c764 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74252024-11-09T02:53:14.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84512599-9694-4b25-80fa-24cabd91c764 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74262024-11-09T02:53:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 504 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 26e72c87-e681-4863-aea1-db7d689ffbb6 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
74272024-11-09T02:53:15.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1078fe33-f14f-4f65-baea-dfaa2c86bd84 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74282024-11-09T02:53:15.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1078fe33-f14f-4f65-baea-dfaa2c86bd84 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74292024-11-09T02:53:15.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1078fe33-f14f-4f65-baea-dfaa2c86bd84 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74302024-11-09T02:53:16.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12fbe84d-e2ba-42e3-8f13-d70e37887387 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74312024-11-09T02:53:16.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12fbe84d-e2ba-42e3-8f13-d70e37887387 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74322024-11-09T02:53:16.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12fbe84d-e2ba-42e3-8f13-d70e37887387 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74332024-11-09T02:53:17.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f4605c8-a7f1-46c6-8411-78fc456d03fc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74342024-11-09T02:53:17.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f4605c8-a7f1-46c6-8411-78fc456d03fc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74352024-11-09T02:53:17.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f4605c8-a7f1-46c6-8411-78fc456d03fc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74362024-11-09T02:53:18.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cae0909f-aad9-45bc-aee6-146d22c2450e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74372024-11-09T02:53:18.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cae0909f-aad9-45bc-aee6-146d22c2450e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74382024-11-09T02:53:18.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cae0909f-aad9-45bc-aee6-146d22c2450e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74392024-11-09T02:53:19.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0e5d94dc-fd9c-4095-a8aa-d18709558ddc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74402024-11-09T02:53:19.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0e5d94dc-fd9c-4095-a8aa-d18709558ddc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74412024-11-09T02:53:19.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0e5d94dc-fd9c-4095-a8aa-d18709558ddc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74422024-11-09T02:53:20.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 463b0456-3a16-4a86-a44a-b1c7443e0de3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74432024-11-09T02:53:20.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 463b0456-3a16-4a86-a44a-b1c7443e0de3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74442024-11-09T02:53:20.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 463b0456-3a16-4a86-a44a-b1c7443e0de3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74452024-11-09T02:53:21.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef607381-18f3-421a-82ec-d7045725da77 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74462024-11-09T02:53:21.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef607381-18f3-421a-82ec-d7045725da77 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74472024-11-09T02:53:21.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef607381-18f3-421a-82ec-d7045725da77 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74482024-11-09T02:53:22.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20d48390-3055-449b-a866-aeda28d3e754 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74492024-11-09T02:53:22.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20d48390-3055-449b-a866-aeda28d3e754 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74502024-11-09T02:53:22.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20d48390-3055-449b-a866-aeda28d3e754 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74512024-11-09T02:53:23.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
74522024-11-09T02:53:23.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
74532024-11-09T02:53:23.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74542024-11-09T02:53:23.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74552024-11-09T02:53:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74562024-11-09T02:53:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74572024-11-09T02:53:23.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582024-11-09T02:53:23.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74592024-11-09T02:53:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74602024-11-09T02:53:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74612024-11-09T02:53:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74622024-11-09T02:53:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74632024-11-09T02:53:23.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74642024-11-09T02:53:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74652024-11-09T02:53:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74662024-11-09T02:53:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
74672024-11-09T02:53:23.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74682024-11-09T02:53:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74692024-11-09T02:53:23.194ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
74702024-11-09T02:53:23.194ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.645881ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
74712024-11-09T02:53:23.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.271102ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74722024-11-09T02:53:23.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7666760-e9e5-4886-8752-e488ffcc33a0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74732024-11-09T02:53:23.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7666760-e9e5-4886-8752-e488ffcc33a0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74742024-11-09T02:53:23.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e7666760-e9e5-4886-8752-e488ffcc33a0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74752024-11-09T02:53:24.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a8cab19e-ca6f-45c0-bfa8-a5728c2a6364 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74762024-11-09T02:53:24.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a8cab19e-ca6f-45c0-bfa8-a5728c2a6364 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74772024-11-09T02:53:24.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a8cab19e-ca6f-45c0-bfa8-a5728c2a6364 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74782024-11-09T02:53:25.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a48c5877-1240-4fd3-8a33-1efd9de4b663 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74792024-11-09T02:53:25.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a48c5877-1240-4fd3-8a33-1efd9de4b663 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74802024-11-09T02:53:25.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a48c5877-1240-4fd3-8a33-1efd9de4b663 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74812024-11-09T02:53:26.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9346bcc-3e3f-4ce3-8e10-4a834ec6a40a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74822024-11-09T02:53:26.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9346bcc-3e3f-4ce3-8e10-4a834ec6a40a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74832024-11-09T02:53:26.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9346bcc-3e3f-4ce3-8e10-4a834ec6a40a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74842024-11-09T02:53:27.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62e3675f-9c91-4f33-af3b-2890301cd561 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74852024-11-09T02:53:27.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62e3675f-9c91-4f33-af3b-2890301cd561 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74862024-11-09T02:53:27.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62e3675f-9c91-4f33-af3b-2890301cd561 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74872024-11-09T02:53:28.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d086a283-a52e-49aa-b6f1-ae93be812eaf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74882024-11-09T02:53:28.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d086a283-a52e-49aa-b6f1-ae93be812eaf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74892024-11-09T02:53:28.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d086a283-a52e-49aa-b6f1-ae93be812eaf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74902024-11-09T02:53:29.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1a1094e4-a931-480c-aea0-ada81f98bf7c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74912024-11-09T02:53:29.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1a1094e4-a931-480c-aea0-ada81f98bf7c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74922024-11-09T02:53:29.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1a1094e4-a931-480c-aea0-ada81f98bf7c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74932024-11-09T02:53:30.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 501 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 854211d5-a050-49e0-a868-a1bbd7352892 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
74942024-11-09T02:53:30.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 654b2ee6-8dd5-43b7-aff9-f2033eff3f43 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74952024-11-09T02:53:30.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 654b2ee6-8dd5-43b7-aff9-f2033eff3f43 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74962024-11-09T02:53:30.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 654b2ee6-8dd5-43b7-aff9-f2033eff3f43 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74972024-11-09T02:53:31.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d3b1ebe-a686-4135-b22c-08adc43030af roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74982024-11-09T02:53:31.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d3b1ebe-a686-4135-b22c-08adc43030af resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
74992024-11-09T02:53:31.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d3b1ebe-a686-4135-b22c-08adc43030af response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
75002024-11-09T02:53:32.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6336be74-6b8f-473b-8be0-f9ed6c9f5870 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
75012024-11-09T02:53:32.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6336be74-6b8f-473b-8be0-f9ed6c9f5870 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
75022024-11-09T02:53:32.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6336be74-6b8f-473b-8be0-f9ed6c9f5870 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
75032024-11-09T02:53:33.168ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75042024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75052024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75062024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
75072024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
75082024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75092024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75102024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
75112024-11-09T02:53:33.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75122024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
75132024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75142024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75152024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
75162024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75172024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75182024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75192024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75202024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
75212024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75222024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75232024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
75242024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
75252024-11-09T02:53:33.169ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75262024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75272024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75282024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
75292024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75302024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75312024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
75322024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
75332024-11-09T02:53:33.169ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
75342024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75352024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.131\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
75362024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
75372024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
75382024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75392024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75402024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
75412024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
75422024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75432024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
75442024-11-09T02:53:33.169ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:43:33.169349899 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75452024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
75462024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75472024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
75482024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75492024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75502024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
75512024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75522024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75532024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
75542024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
75552024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.88\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
75562024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
75572024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.06\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
75582024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.61\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
75592024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
75602024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.91\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
75612024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
75622024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
75632024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75642024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75652024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75662024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75672024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75682024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75692024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75702024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75712024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75722024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75732024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75742024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75752024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75762024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75772024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75782024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75792024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75802024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75812024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75822024-11-09T02:53:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75832024-11-09T02:53:33.169ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 507795862 } })
75842024-11-09T02:53:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75852024-11-09T02:53:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75862024-11-09T02:53:33.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 507945696 } })
75872024-11-09T02:53:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
75882024-11-09T02:53:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.357108ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
75892024-11-09T02:53:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
75902024-11-09T02:53:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.388069ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
75912024-11-09T02:53:33.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.909202ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75922024-11-09T02:53:33.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75932024-11-09T02:53:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75942024-11-09T02:53:33.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75952024-11-09T02:53:33.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75962024-11-09T02:53:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75972024-11-09T02:53:33.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75982024-11-09T02:53:33.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 520589417 } })
75992024-11-09T02:53:33.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
76002024-11-09T02:53:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76012024-11-09T02:53:33.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76022024-11-09T02:53:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76032024-11-09T02:53:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76042024-11-09T02:53:33.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76052024-11-09T02:53:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76062024-11-09T02:53:33.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76072024-11-09T02:53:33.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76082024-11-09T02:53:33.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76092024-11-09T02:53:33.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76102024-11-09T02:53:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76112024-11-09T02:53:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76122024-11-09T02:53:33.191ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76132024-11-09T02:53:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76142024-11-09T02:53:33.192ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152024-11-09T02:53:33.193ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 531097514 } })
76162024-11-09T02:53:33.193ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
76172024-11-09T02:53:33.193ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76182024-11-09T02:53:33.194ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:43:33.169349899 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76192024-11-09T02:53:33.194ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.16213ms iteration = 8 status = {"expiration":"2024-11-09T02:43:33.169349899Z","pruned":[]}
76202024-11-09T02:53:33.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76212024-11-09T02:53:33.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76222024-11-09T02:53:33.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76232024-11-09T02:53:33.196ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76242024-11-09T02:53:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76252024-11-09T02:53:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76262024-11-09T02:53:33.198ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76272024-11-09T02:53:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76282024-11-09T02:53:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76292024-11-09T02:53:33.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76302024-11-09T02:53:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76312024-11-09T02:53:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76322024-11-09T02:53:33.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76332024-11-09T02:53:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76342024-11-09T02:53:33.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76352024-11-09T02:53:33.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76362024-11-09T02:53:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76372024-11-09T02:53:33.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76382024-11-09T02:53:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76392024-11-09T02:53:33.208ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 39.223231ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
76402024-11-09T02:53:33.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76412024-11-09T02:53:33.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76422024-11-09T02:53:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76432024-11-09T02:53:33.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76442024-11-09T02:53:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76452024-11-09T02:53:33.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76462024-11-09T02:53:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76472024-11-09T02:53:33.214ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 552752112 } })
76482024-11-09T02:53:33.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76492024-11-09T02:53:33.215ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
76502024-11-09T02:53:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76512024-11-09T02:53:33.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76522024-11-09T02:53:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76532024-11-09T02:53:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76542024-11-09T02:53:33.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76552024-11-09T02:53:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76562024-11-09T02:53:33.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76572024-11-09T02:53:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
76582024-11-09T02:53:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76592024-11-09T02:53:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76602024-11-09T02:53:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
76612024-11-09T02:53:33.225ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76622024-11-09T02:53:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76632024-11-09T02:53:33.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76642024-11-09T02:53:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76652024-11-09T02:53:33.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
76662024-11-09T02:53:33.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.171304ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
76672024-11-09T02:53:33.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76682024-11-09T02:53:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76692024-11-09T02:53:33.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76702024-11-09T02:53:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76712024-11-09T02:53:33.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.55906ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76722024-11-09T02:53:33.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76732024-11-09T02:53:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76742024-11-09T02:53:33.259ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76752024-11-09T02:53:33.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76762024-11-09T02:53:33.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76772024-11-09T02:53:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76782024-11-09T02:53:33.263ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76792024-11-09T02:53:33.263ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76802024-11-09T02:53:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 94.505394ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76812024-11-09T02:53:33.268ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76822024-11-09T02:53:33.268ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76832024-11-09T02:53:33.268ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76842024-11-09T02:53:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76852024-11-09T02:53:33.269ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76862024-11-09T02:53:33.269ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76872024-11-09T02:53:33.269ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76882024-11-09T02:53:33.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76892024-11-09T02:53:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76902024-11-09T02:53:33.270ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76912024-11-09T02:53:33.270ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76922024-11-09T02:53:33.270ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.874734ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76932024-11-09T02:53:33.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76942024-11-09T02:53:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76952024-11-09T02:53:33.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76962024-11-09T02:53:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76972024-11-09T02:53:33.277ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76982024-11-09T02:53:33.277ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.171466ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76992024-11-09T02:53:33.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77002024-11-09T02:53:33.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77012024-11-09T02:53:33.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77022024-11-09T02:53:33.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77032024-11-09T02:53:33.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77042024-11-09T02:53:33.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77052024-11-09T02:53:33.295ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77062024-11-09T02:53:33.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77072024-11-09T02:53:33.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.558648ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77082024-11-09T02:53:33.301ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77092024-11-09T02:53:33.301ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77102024-11-09T02:53:33.301ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77112024-11-09T02:53:33.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77122024-11-09T02:53:33.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77132024-11-09T02:53:33.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77142024-11-09T02:53:33.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
77152024-11-09T02:53:33.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77162024-11-09T02:53:33.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77172024-11-09T02:53:33.314ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77182024-11-09T02:53:33.314ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.268312ms iteration = 15 status = 0
77192024-11-09T02:53:33.323ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77202024-11-09T02:53:33.323ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77212024-11-09T02:53:33.323ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77222024-11-09T02:53:33.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77232024-11-09T02:53:33.334ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77242024-11-09T02:53:33.334ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77252024-11-09T02:53:33.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77262024-11-09T02:53:33.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77272024-11-09T02:53:33.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77282024-11-09T02:53:33.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77292024-11-09T02:53:33.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77302024-11-09T02:53:33.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77312024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
77322024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77332024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
77342024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 173.976356ms iteration = 8 status = {"generation":1}
77352024-11-09T02:53:33.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77362024-11-09T02:53:33.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77372024-11-09T02:53:33.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77382024-11-09T02:53:33.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77392024-11-09T02:53:33.357ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
77402024-11-09T02:53:33.357ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 188.557027ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77412024-11-09T02:53:33.359ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.207001ms iteration = 17 status = {"physical_disks_added":0}
77422024-11-09T02:53:33.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
77432024-11-09T02:53:33.359ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77442024-11-09T02:53:33.359ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5891b230-c183-4896-aa09-2ef91db8bf6a", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
77452024-11-09T02:53:33.359ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77462024-11-09T02:53:33.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77472024-11-09T02:53:33.369ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77482024-11-09T02:53:33.369ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77492024-11-09T02:53:33.369ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 200.525544ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77502024-11-09T02:53:33.385ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77512024-11-09T02:53:33.385ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 216.504484ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77522024-11-09T02:53:33.386ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77532024-11-09T02:53:33.386ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
77542024-11-09T02:53:33.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77552024-11-09T02:53:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77562024-11-09T02:53:33.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77572024-11-09T02:53:33.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
77582024-11-09T02:53:33.388ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77592024-11-09T02:53:33.389ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb51f16d-d014-4112-b48a-a2ebcc2ed8c5", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
77602024-11-09T02:53:33.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77612024-11-09T02:53:33.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77622024-11-09T02:53:33.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77632024-11-09T02:53:33.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77642024-11-09T02:53:33.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77652024-11-09T02:53:33.393ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77662024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
77672024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77682024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
77692024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 224.589881ms iteration = 8 status = {"generation":2}
77702024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77712024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fc2d4a0-0965-45ea-888e-2ddecb7cff58", "content-length": "372", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
77722024-11-09T02:53:33.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77732024-11-09T02:53:33.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77742024-11-09T02:53:33.394ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
77752024-11-09T02:53:33.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77762024-11-09T02:53:33.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77772024-11-09T02:53:33.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77782024-11-09T02:53:33.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77792024-11-09T02:53:33.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77802024-11-09T02:53:33.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77812024-11-09T02:53:33.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77822024-11-09T02:53:33.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77832024-11-09T02:53:33.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77842024-11-09T02:53:33.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77852024-11-09T02:53:33.412ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
77862024-11-09T02:53:33.412ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77872024-11-09T02:53:33.412ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "196d523b-afe0-466c-a99b-616dd49d29e0", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
77882024-11-09T02:53:33.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77892024-11-09T02:53:33.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77902024-11-09T02:53:33.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77912024-11-09T02:53:33.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77922024-11-09T02:53:33.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77932024-11-09T02:53:33.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77942024-11-09T02:53:33.422ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77952024-11-09T02:53:33.422ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77962024-11-09T02:53:33.423ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1bf36499-e251-4d0a-acef-8ec336b064f8", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
77972024-11-09T02:53:33.425ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 256.48307ms iteration = 15 status = {}
77982024-11-09T02:53:33.481ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77992024-11-09T02:53:33.481ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3089fca3-f3c6-4526-bf3e-d51cd1b7ccb3", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78002024-11-09T02:53:33.481ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78012024-11-09T02:53:33.483ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f823d99b-6852-4329-a65f-17d32a66eff5", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78022024-11-09T02:53:33.483ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78032024-11-09T02:53:33.484ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78042024-11-09T02:53:33.484ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 315.365027ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78052024-11-09T02:53:33.515ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 346.177664ms iteration = 15 status = {}
78062024-11-09T02:53:33.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
78072024-11-09T02:53:33.524ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78082024-11-09T02:53:33.524ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a36ac52-f9c2-43e1-9e0e-410339b8eb7e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78092024-11-09T02:53:33.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78102024-11-09T02:53:33.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
78112024-11-09T02:53:33.550ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78122024-11-09T02:53:33.550ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05737c00-d989-4103-a601-41e7b6f3605a", "content-length": "1", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78132024-11-09T02:53:33.551ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78142024-11-09T02:53:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78152024-11-09T02:53:33.554ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 384.687199ms iteration = 15 status = null
78162024-11-09T02:53:33.555ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78172024-11-09T02:53:33.556ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "603c71d8-a386-4886-88c2-89f6aba214d9", "content-length": "691", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78182024-11-09T02:53:33.556ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78192024-11-09T02:53:33.556ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78202024-11-09T02:53:33.556ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78212024-11-09T02:53:33.557ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.760234ms iteration = 15 status = {}
78222024-11-09T02:53:33.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78232024-11-09T02:53:33.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78242024-11-09T02:53:33.639ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e1bff298-22ee-45d2-97f5-b973665531c9", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78252024-11-09T02:53:33.639ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78262024-11-09T02:53:33.641ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5bd6b56f-335a-4120-ab10-b8b811d22300", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78272024-11-09T02:53:33.641ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78282024-11-09T02:53:33.642ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "877c40e6-9acb-4e39-b3df-ded079a3f7c4", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78292024-11-09T02:53:33.642ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78302024-11-09T02:53:33.644ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78312024-11-09T02:53:33.644ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 475.246811ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78322024-11-09T02:53:33.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78332024-11-09T02:53:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78342024-11-09T02:53:33.685ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
78352024-11-09T02:53:33.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78362024-11-09T02:53:33.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78372024-11-09T02:53:33.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78382024-11-09T02:53:33.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a55a85d3-abef-4b25-98f9-840261518853", "content-length": "134", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78392024-11-09T02:53:33.695ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78402024-11-09T02:53:33.695ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
78412024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78422024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78432024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78442024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78452024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78462024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78472024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78482024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78492024-11-09T02:53:33.696ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
78502024-11-09T02:53:33.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78512024-11-09T02:53:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78522024-11-09T02:53:33.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78532024-11-09T02:53:33.698ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cea5b58-6ce0-42a7-9b15-05daf9895ca7", "content-length": "2", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78542024-11-09T02:53:33.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78552024-11-09T02:53:33.698ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b96bcc-6c65-4215-a077-dfef05daa419", "content-length": "52", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78562024-11-09T02:53:33.698ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
78572024-11-09T02:53:33.698ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78582024-11-09T02:53:33.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de720827-55b8-424f-bd99-015959135bd3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78592024-11-09T02:53:33.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de720827-55b8-424f-bd99-015959135bd3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78602024-11-09T02:53:33.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e518a767-c158-4f44-8bf7-8c3dd7fe55c3", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78612024-11-09T02:53:33.878ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
78622024-11-09T02:53:33.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78632024-11-09T02:53:33.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de720827-55b8-424f-bd99-015959135bd3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78642024-11-09T02:53:33.884ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf4b1b21-59e0-4f3d-b686-56b3baeb76e4", "content-length": "682", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
78652024-11-09T02:53:33.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78662024-11-09T02:53:33.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78672024-11-09T02:53:33.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78682024-11-09T02:53:33.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78692024-11-09T02:53:33.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78702024-11-09T02:53:33.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78712024-11-09T02:53:33.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78722024-11-09T02:53:33.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78732024-11-09T02:53:33.902ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 732.803874ms iteration = 15 status = {}
78742024-11-09T02:53:34.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 516b6ddc-d0b4-429c-b25d-fc645647471c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
78752024-11-09T02:53:34.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 516b6ddc-d0b4-429c-b25d-fc645647471c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
78762024-11-09T02:53:34.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 516b6ddc-d0b4-429c-b25d-fc645647471c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
78772024-11-09T02:53:34.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef5621a3-76a7-45ef-9d7a-e56ffb49bf01 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78782024-11-09T02:53:34.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef5621a3-76a7-45ef-9d7a-e56ffb49bf01 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78792024-11-09T02:53:34.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef5621a3-76a7-45ef-9d7a-e56ffb49bf01 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78802024-11-09T02:53:35.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d7c76b7-e46c-4948-92f4-a4245c2d8ba2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78812024-11-09T02:53:35.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d7c76b7-e46c-4948-92f4-a4245c2d8ba2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78822024-11-09T02:53:35.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d7c76b7-e46c-4948-92f4-a4245c2d8ba2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78832024-11-09T02:53:36.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca0747ef-33ec-4084-90ee-378a502c8111 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78842024-11-09T02:53:36.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca0747ef-33ec-4084-90ee-378a502c8111 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78852024-11-09T02:53:36.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ca0747ef-33ec-4084-90ee-378a502c8111 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78862024-11-09T02:53:37.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 126da96e-3f53-4f9f-9cbf-fca827fb3619 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78872024-11-09T02:53:37.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 126da96e-3f53-4f9f-9cbf-fca827fb3619 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78882024-11-09T02:53:37.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 126da96e-3f53-4f9f-9cbf-fca827fb3619 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78892024-11-09T02:53:38.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f6c3e9e-5e60-4224-98cc-5ee79fd70009 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78902024-11-09T02:53:38.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f6c3e9e-5e60-4224-98cc-5ee79fd70009 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78912024-11-09T02:53:38.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f6c3e9e-5e60-4224-98cc-5ee79fd70009 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78922024-11-09T02:53:40.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d526e55-b658-43f8-a50b-a77fb4c6f040 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78932024-11-09T02:53:40.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d526e55-b658-43f8-a50b-a77fb4c6f040 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78942024-11-09T02:53:40.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d526e55-b658-43f8-a50b-a77fb4c6f040 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78952024-11-09T02:53:41.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d3fbffd-32c8-41b1-b0d9-a80cccf75238 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78962024-11-09T02:53:41.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d3fbffd-32c8-41b1-b0d9-a80cccf75238 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78972024-11-09T02:53:41.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d3fbffd-32c8-41b1-b0d9-a80cccf75238 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78982024-11-09T02:53:42.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ecf4218b-8866-4d7d-9d16-df3299f2f7ef roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
78992024-11-09T02:53:42.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ecf4218b-8866-4d7d-9d16-df3299f2f7ef resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79002024-11-09T02:53:42.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ecf4218b-8866-4d7d-9d16-df3299f2f7ef response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79012024-11-09T02:53:43.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55e144c7-2123-4816-b02b-91715518261b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79022024-11-09T02:53:43.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55e144c7-2123-4816-b02b-91715518261b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79032024-11-09T02:53:43.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55e144c7-2123-4816-b02b-91715518261b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79042024-11-09T02:53:43.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
79052024-11-09T02:53:43.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
79062024-11-09T02:53:43.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79072024-11-09T02:53:43.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79082024-11-09T02:53:43.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79092024-11-09T02:53:43.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79102024-11-09T02:53:43.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79112024-11-09T02:53:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79122024-11-09T02:53:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79132024-11-09T02:53:43.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.41014ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79142024-11-09T02:53:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79152024-11-09T02:53:43.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79162024-11-09T02:53:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79172024-11-09T02:53:43.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79182024-11-09T02:53:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79192024-11-09T02:53:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79202024-11-09T02:53:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
79212024-11-09T02:53:43.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79222024-11-09T02:53:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79232024-11-09T02:53:43.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
79242024-11-09T02:53:43.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.521124ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
79252024-11-09T02:53:44.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa81289c-220a-46e8-b8e0-e1f595c366fd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79262024-11-09T02:53:44.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa81289c-220a-46e8-b8e0-e1f595c366fd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79272024-11-09T02:53:44.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa81289c-220a-46e8-b8e0-e1f595c366fd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79282024-11-09T02:53:45.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33529c5d-1fc2-42ab-b72f-70fd75fba167 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79292024-11-09T02:53:45.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33529c5d-1fc2-42ab-b72f-70fd75fba167 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79302024-11-09T02:53:45.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33529c5d-1fc2-42ab-b72f-70fd75fba167 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79312024-11-09T02:53:45.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 510 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c7265a8f-3729-45b6-a277-8bcf756da6ad response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
79322024-11-09T02:53:46.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1eecec15-8b2c-4711-a9d4-6c375f1e1a1a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79332024-11-09T02:53:46.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1eecec15-8b2c-4711-a9d4-6c375f1e1a1a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79342024-11-09T02:53:46.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1eecec15-8b2c-4711-a9d4-6c375f1e1a1a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79352024-11-09T02:53:47.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1071c841-6008-4f7a-a3dd-4de4c837e134 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79362024-11-09T02:53:47.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1071c841-6008-4f7a-a3dd-4de4c837e134 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79372024-11-09T02:53:47.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1071c841-6008-4f7a-a3dd-4de4c837e134 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79382024-11-09T02:53:48.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9beac45d-36a2-422a-bc18-6cf5494fba98 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79392024-11-09T02:53:48.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9beac45d-36a2-422a-bc18-6cf5494fba98 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79402024-11-09T02:53:48.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9beac45d-36a2-422a-bc18-6cf5494fba98 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79412024-11-09T02:53:49.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a81672da-7b44-44dc-a111-edcc588bbd22 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79422024-11-09T02:53:49.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a81672da-7b44-44dc-a111-edcc588bbd22 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79432024-11-09T02:53:49.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a81672da-7b44-44dc-a111-edcc588bbd22 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79442024-11-09T02:53:50.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a73136a2-947e-47b2-8990-f4f29054986c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79452024-11-09T02:53:50.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a73136a2-947e-47b2-8990-f4f29054986c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79462024-11-09T02:53:50.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a73136a2-947e-47b2-8990-f4f29054986c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79472024-11-09T02:53:51.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33f93ea2-7c8d-42d2-95bf-002f55c153eb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79482024-11-09T02:53:51.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33f93ea2-7c8d-42d2-95bf-002f55c153eb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79492024-11-09T02:53:51.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33f93ea2-7c8d-42d2-95bf-002f55c153eb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79502024-11-09T02:53:52.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1b6fa13-06fe-4544-b7f3-cbb378a19997 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79512024-11-09T02:53:52.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1b6fa13-06fe-4544-b7f3-cbb378a19997 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79522024-11-09T02:53:52.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1b6fa13-06fe-4544-b7f3-cbb378a19997 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79532024-11-09T02:53:53.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
79542024-11-09T02:53:53.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
79552024-11-09T02:53:53.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79562024-11-09T02:53:53.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79572024-11-09T02:53:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79582024-11-09T02:53:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79592024-11-09T02:53:53.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79602024-11-09T02:53:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79612024-11-09T02:53:53.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79622024-11-09T02:53:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79632024-11-09T02:53:53.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79642024-11-09T02:53:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79652024-11-09T02:53:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79662024-11-09T02:53:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
79672024-11-09T02:53:53.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79682024-11-09T02:53:53.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79692024-11-09T02:53:53.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
79702024-11-09T02:53:53.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.593117ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
79712024-11-09T02:53:53.196ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79722024-11-09T02:53:53.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79732024-11-09T02:53:53.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.699364ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79742024-11-09T02:53:53.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df06064f-3cd3-4373-83c8-6412c7023cca roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79752024-11-09T02:53:53.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df06064f-3cd3-4373-83c8-6412c7023cca resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79762024-11-09T02:53:53.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df06064f-3cd3-4373-83c8-6412c7023cca response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79772024-11-09T02:53:54.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 74bbf585-a6c0-4fa3-90bc-b4885f4c6802 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79782024-11-09T02:53:54.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 74bbf585-a6c0-4fa3-90bc-b4885f4c6802 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79792024-11-09T02:53:54.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 74bbf585-a6c0-4fa3-90bc-b4885f4c6802 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79802024-11-09T02:53:55.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8b1557ef-c892-47a6-a9f9-5b203f51b4c7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79812024-11-09T02:53:55.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8b1557ef-c892-47a6-a9f9-5b203f51b4c7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79822024-11-09T02:53:55.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8b1557ef-c892-47a6-a9f9-5b203f51b4c7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79832024-11-09T02:53:56.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b5e6b8d5-ae1d-472d-9cc6-9cab57c41e18 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79842024-11-09T02:53:56.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b5e6b8d5-ae1d-472d-9cc6-9cab57c41e18 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79852024-11-09T02:53:56.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b5e6b8d5-ae1d-472d-9cc6-9cab57c41e18 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79862024-11-09T02:53:57.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdc141bc-88f8-46ce-b2e7-51b0e6fac41b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79872024-11-09T02:53:57.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdc141bc-88f8-46ce-b2e7-51b0e6fac41b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79882024-11-09T02:53:57.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdc141bc-88f8-46ce-b2e7-51b0e6fac41b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79892024-11-09T02:53:58.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79754481-b52d-45d7-abd2-ffc6b81b7033 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79902024-11-09T02:53:58.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79754481-b52d-45d7-abd2-ffc6b81b7033 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79912024-11-09T02:53:58.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79754481-b52d-45d7-abd2-ffc6b81b7033 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79922024-11-09T02:53:59.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8719284b-07dc-4569-a7eb-ae681452c99c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79932024-11-09T02:53:59.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8719284b-07dc-4569-a7eb-ae681452c99c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79942024-11-09T02:53:59.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8719284b-07dc-4569-a7eb-ae681452c99c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79952024-11-09T02:54:00.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 561 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 1fd2d5ce-64de-4b1a-8037-9a7f1a62f7e0 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
79962024-11-09T02:54:00.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 36d60ac9-f901-4349-96c4-56a22b0048a9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79972024-11-09T02:54:00.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 36d60ac9-f901-4349-96c4-56a22b0048a9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79982024-11-09T02:54:00.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 36d60ac9-f901-4349-96c4-56a22b0048a9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
79992024-11-09T02:54:01.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6134126-837b-4a0c-9bae-b179aaf303cc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
80002024-11-09T02:54:01.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6134126-837b-4a0c-9bae-b179aaf303cc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
80012024-11-09T02:54:01.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6134126-837b-4a0c-9bae-b179aaf303cc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
80022024-11-09T02:54:02.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cc96096d-c582-49a3-bd82-b2bcb7308dcd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
80032024-11-09T02:54:02.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cc96096d-c582-49a3-bd82-b2bcb7308dcd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
80042024-11-09T02:54:02.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cc96096d-c582-49a3-bd82-b2bcb7308dcd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
80052024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
80062024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80072024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
80082024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
80092024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80102024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80112024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
80122024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80132024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
80142024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
80152024-11-09T02:54:03.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80162024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80172024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
80182024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80192024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80202024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
80212024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
80222024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
80232024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
80242024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80252024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80262024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80272024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80282024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
80292024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80302024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
80312024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80322024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
80332024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.69\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80342024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
80352024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
80362024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.29\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
80372024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.74\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80382024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
80392024-11-09T02:54:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.85\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
80402024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80412024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80422024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80432024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80442024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80452024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80462024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80472024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80482024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80492024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80502024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80512024-11-09T02:54:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80522024-11-09T02:54:03.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80532024-11-09T02:54:03.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 511130311 } })
80542024-11-09T02:54:03.173ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
80552024-11-09T02:54:03.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80562024-11-09T02:54:03.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.88621ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80572024-11-09T02:54:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80582024-11-09T02:54:03.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80592024-11-09T02:54:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80602024-11-09T02:54:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80612024-11-09T02:54:03.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80622024-11-09T02:54:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80632024-11-09T02:54:03.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80642024-11-09T02:54:03.179ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80652024-11-09T02:54:03.179ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80662024-11-09T02:54:03.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80672024-11-09T02:54:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80682024-11-09T02:54:03.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80692024-11-09T02:54:03.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80702024-11-09T02:54:03.181ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 518757029 } })
80712024-11-09T02:54:03.181ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
80722024-11-09T02:54:03.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80732024-11-09T02:54:03.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80742024-11-09T02:54:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80752024-11-09T02:54:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80762024-11-09T02:54:03.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80772024-11-09T02:54:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80782024-11-09T02:54:03.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-11-09T02:54:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80802024-11-09T02:54:03.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80812024-11-09T02:54:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80822024-11-09T02:54:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80832024-11-09T02:54:03.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80842024-11-09T02:54:03.186ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80852024-11-09T02:54:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80862024-11-09T02:54:03.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80872024-11-09T02:54:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80882024-11-09T02:54:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80892024-11-09T02:54:03.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80902024-11-09T02:54:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80912024-11-09T02:54:03.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80922024-11-09T02:54:03.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80932024-11-09T02:54:03.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80942024-11-09T02:54:03.200ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 537637359 } })
80952024-11-09T02:54:03.200ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
80962024-11-09T02:54:03.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80972024-11-09T02:54:03.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80982024-11-09T02:54:03.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80992024-11-09T02:54:03.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
81002024-11-09T02:54:03.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81012024-11-09T02:54:03.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81022024-11-09T02:54:03.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81032024-11-09T02:54:03.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81042024-11-09T02:54:03.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81052024-11-09T02:54:03.216ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
81062024-11-09T02:54:03.216ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.197835ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
81072024-11-09T02:54:03.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81082024-11-09T02:54:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81092024-11-09T02:54:03.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.10395ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81102024-11-09T02:54:03.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81112024-11-09T02:54:03.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81122024-11-09T02:54:03.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81132024-11-09T02:54:03.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81142024-11-09T02:54:03.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81152024-11-09T02:54:03.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81162024-11-09T02:54:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.464092ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81172024-11-09T02:54:03.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81182024-11-09T02:54:03.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
81192024-11-09T02:54:03.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81202024-11-09T02:54:03.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81212024-11-09T02:54:03.238ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81222024-11-09T02:54:03.238ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81232024-11-09T02:54:03.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81242024-11-09T02:54:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81252024-11-09T02:54:03.240ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.898976ms iteration = 16 status = 0
81262024-11-09T02:54:03.242ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81272024-11-09T02:54:03.242ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.381896ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81282024-11-09T02:54:03.253ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
81292024-11-09T02:54:03.253ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81302024-11-09T02:54:03.254ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63f5cfcf-df53-4ff1-8a3d-faa918f6e097", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:02 GMT"} })
81312024-11-09T02:54:03.254ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81322024-11-09T02:54:03.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81332024-11-09T02:54:03.268ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
81342024-11-09T02:54:03.268ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81352024-11-09T02:54:03.269ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6d244f3-edb6-4913-8959-60e507f19724", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:02 GMT"} })
81362024-11-09T02:54:03.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81372024-11-09T02:54:03.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81382024-11-09T02:54:03.283ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81392024-11-09T02:54:03.283ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81402024-11-09T02:54:03.283ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.755321ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81412024-11-09T02:54:03.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
81422024-11-09T02:54:03.284ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81432024-11-09T02:54:03.284ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4100625a-e1b3-4545-8187-389b728237d4", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:02 GMT"} })
81442024-11-09T02:54:03.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81452024-11-09T02:54:03.285ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
81462024-11-09T02:54:03.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81472024-11-09T02:54:03.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81482024-11-09T02:54:03.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81492024-11-09T02:54:03.312ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.487205ms iteration = 18 status = {"physical_disks_added":0}
81502024-11-09T02:54:03.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81512024-11-09T02:54:03.366ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81522024-11-09T02:54:03.367ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e5504a8-c59c-4d00-83cd-0e6bd1db1c04", "content-length": "1", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
81532024-11-09T02:54:03.368ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81542024-11-09T02:54:03.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81552024-11-09T02:54:03.458ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 289.239207ms iteration = 16 status = {}
81562024-11-09T02:54:03.472ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81572024-11-09T02:54:03.472ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81582024-11-09T02:54:03.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81592024-11-09T02:54:03.475ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 306.019144ms iteration = 16 status = null
81602024-11-09T02:54:03.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81612024-11-09T02:54:03.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81622024-11-09T02:54:03.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81632024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81642024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccd8d7a3-80f9-4d88-a17d-d72cca7f0d33", "content-length": "372", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
81652024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81662024-11-09T02:54:03.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81672024-11-09T02:54:03.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81682024-11-09T02:54:03.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81692024-11-09T02:54:03.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81702024-11-09T02:54:03.496ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81712024-11-09T02:54:03.496ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81722024-11-09T02:54:03.496ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7bfe1990-484b-41a5-87b6-3ed8c5bef34d", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
81732024-11-09T02:54:03.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81742024-11-09T02:54:03.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81752024-11-09T02:54:03.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81762024-11-09T02:54:03.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81772024-11-09T02:54:03.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81782024-11-09T02:54:03.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81792024-11-09T02:54:03.505ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81802024-11-09T02:54:03.505ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81812024-11-09T02:54:03.506ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d67c32d1-6922-4016-9c4b-989d8e36d268", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
81822024-11-09T02:54:03.508ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 338.761151ms iteration = 16 status = {}
81832024-11-09T02:54:03.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81842024-11-09T02:54:03.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81852024-11-09T02:54:03.538ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81862024-11-09T02:54:03.539ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "79b41538-1050-4250-8dbf-5f04597e09bb", "content-length": "691", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
81872024-11-09T02:54:03.539ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81882024-11-09T02:54:03.539ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81892024-11-09T02:54:03.539ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81902024-11-09T02:54:03.540ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 370.612728ms iteration = 16 status = {}
81912024-11-09T02:54:03.540ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
81922024-11-09T02:54:03.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81932024-11-09T02:54:03.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81942024-11-09T02:54:03.549ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81952024-11-09T02:54:03.549ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "516455a6-b3c6-4cc0-a64d-d36df3bc2c9d", "content-length": "134", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
81962024-11-09T02:54:03.549ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81972024-11-09T02:54:03.549ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
81982024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81992024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82002024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82012024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82022024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82032024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82042024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82052024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82062024-11-09T02:54:03.550ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
82072024-11-09T02:54:03.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82082024-11-09T02:54:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82092024-11-09T02:54:03.552ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82102024-11-09T02:54:03.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a753feb8-899c-47f3-b666-9f69ccb80e97", "content-length": "2", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
82112024-11-09T02:54:03.552ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82122024-11-09T02:54:03.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1221e376-8f54-45b6-9ec3-06e7b6fa6fc7", "content-length": "52", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
82132024-11-09T02:54:03.552ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
82142024-11-09T02:54:03.552ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82152024-11-09T02:54:03.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e764f20e-03e2-4c42-a4e9-08c80c9aea8c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82162024-11-09T02:54:03.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e764f20e-03e2-4c42-a4e9-08c80c9aea8c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82172024-11-09T02:54:03.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e764f20e-03e2-4c42-a4e9-08c80c9aea8c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82182024-11-09T02:54:03.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "02eceaeb-739e-4ea0-8a43-61f3ed32df82", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
82192024-11-09T02:54:03.704ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
82202024-11-09T02:54:03.704ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82212024-11-09T02:54:03.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de754b4-7685-4ced-b45b-2d7145be8a58", "content-length": "682", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
82222024-11-09T02:54:03.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82232024-11-09T02:54:03.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82242024-11-09T02:54:03.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82252024-11-09T02:54:03.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82262024-11-09T02:54:03.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82272024-11-09T02:54:03.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82282024-11-09T02:54:03.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82292024-11-09T02:54:03.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82302024-11-09T02:54:03.721ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 551.366924ms iteration = 16 status = {}
82312024-11-09T02:54:04.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a61f1424-832a-47d3-97bc-e2a07a9fbfc5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
82322024-11-09T02:54:04.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a61f1424-832a-47d3-97bc-e2a07a9fbfc5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
82332024-11-09T02:54:04.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a61f1424-832a-47d3-97bc-e2a07a9fbfc5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
82342024-11-09T02:54:04.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 58d0396e-8a69-440f-b929-ae94798e7883 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82352024-11-09T02:54:04.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 58d0396e-8a69-440f-b929-ae94798e7883 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82362024-11-09T02:54:04.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 58d0396e-8a69-440f-b929-ae94798e7883 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82372024-11-09T02:54:05.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7ae7749-2b2e-4472-9e2b-5993efc84731 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82382024-11-09T02:54:05.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7ae7749-2b2e-4472-9e2b-5993efc84731 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82392024-11-09T02:54:05.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7ae7749-2b2e-4472-9e2b-5993efc84731 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82402024-11-09T02:54:06.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b90817aa-5fc9-4cea-94fd-2c510c02e7ca roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82412024-11-09T02:54:06.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b90817aa-5fc9-4cea-94fd-2c510c02e7ca resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82422024-11-09T02:54:06.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b90817aa-5fc9-4cea-94fd-2c510c02e7ca response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82432024-11-09T02:54:07.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb8d03d0-21d2-49a1-b158-942ecef1771b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82442024-11-09T02:54:07.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb8d03d0-21d2-49a1-b158-942ecef1771b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82452024-11-09T02:54:07.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb8d03d0-21d2-49a1-b158-942ecef1771b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82462024-11-09T02:54:08.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 89dd36df-76a1-41e3-b0ef-65d6175563a5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82472024-11-09T02:54:08.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 89dd36df-76a1-41e3-b0ef-65d6175563a5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82482024-11-09T02:54:08.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 89dd36df-76a1-41e3-b0ef-65d6175563a5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82492024-11-09T02:54:09.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 72578059-af0f-4625-a84e-444d44b1886e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82502024-11-09T02:54:09.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 72578059-af0f-4625-a84e-444d44b1886e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82512024-11-09T02:54:09.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 72578059-af0f-4625-a84e-444d44b1886e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82522024-11-09T02:54:10.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 75b059a2-f7db-457a-bb2a-53f7790483d7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82532024-11-09T02:54:10.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 75b059a2-f7db-457a-bb2a-53f7790483d7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82542024-11-09T02:54:10.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 75b059a2-f7db-457a-bb2a-53f7790483d7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82552024-11-09T02:54:11.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 655f7991-b9d6-446c-8017-4ba863edbd76 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82562024-11-09T02:54:11.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 655f7991-b9d6-446c-8017-4ba863edbd76 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82572024-11-09T02:54:11.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 655f7991-b9d6-446c-8017-4ba863edbd76 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82582024-11-09T02:54:12.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5f73e67a-3a12-4629-896b-ec4afe1e7ed8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82592024-11-09T02:54:12.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5f73e67a-3a12-4629-896b-ec4afe1e7ed8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82602024-11-09T02:54:12.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5f73e67a-3a12-4629-896b-ec4afe1e7ed8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82612024-11-09T02:54:13.168ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
82622024-11-09T02:54:13.168ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
82632024-11-09T02:54:13.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82642024-11-09T02:54:13.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82652024-11-09T02:54:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82662024-11-09T02:54:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82672024-11-09T02:54:13.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82682024-11-09T02:54:13.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82692024-11-09T02:54:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82702024-11-09T02:54:13.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.603325ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82712024-11-09T02:54:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82722024-11-09T02:54:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82732024-11-09T02:54:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82742024-11-09T02:54:13.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82752024-11-09T02:54:13.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82762024-11-09T02:54:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82772024-11-09T02:54:13.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
82782024-11-09T02:54:13.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82792024-11-09T02:54:13.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82802024-11-09T02:54:13.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
82812024-11-09T02:54:13.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.187639ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
82822024-11-09T02:54:13.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63249c34-e1e0-44f5-be1a-bb0b697edd41 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82832024-11-09T02:54:13.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63249c34-e1e0-44f5-be1a-bb0b697edd41 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82842024-11-09T02:54:13.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 63249c34-e1e0-44f5-be1a-bb0b697edd41 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82852024-11-09T02:54:14.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c35e4047-b64d-4f5d-b5c6-33f76325bca1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82862024-11-09T02:54:14.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c35e4047-b64d-4f5d-b5c6-33f76325bca1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82872024-11-09T02:54:14.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c35e4047-b64d-4f5d-b5c6-33f76325bca1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82882024-11-09T02:54:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 664 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 02890a81-42aa-4110-8869-12edfb9ab125 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
82892024-11-09T02:54:15.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1511b96e-9efc-4965-a5f5-6fb10682afcd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82902024-11-09T02:54:15.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1511b96e-9efc-4965-a5f5-6fb10682afcd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82912024-11-09T02:54:15.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1511b96e-9efc-4965-a5f5-6fb10682afcd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82922024-11-09T02:54:16.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea4b5a45-82ee-44cf-ae67-94ca1ff5c8a3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82932024-11-09T02:54:16.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea4b5a45-82ee-44cf-ae67-94ca1ff5c8a3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82942024-11-09T02:54:16.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea4b5a45-82ee-44cf-ae67-94ca1ff5c8a3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82952024-11-09T02:54:17.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 18f159c2-4f1d-4256-ac7e-7e3eae991e18 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82962024-11-09T02:54:17.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 18f159c2-4f1d-4256-ac7e-7e3eae991e18 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82972024-11-09T02:54:17.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 18f159c2-4f1d-4256-ac7e-7e3eae991e18 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82982024-11-09T02:54:18.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fbe25f2-c51d-41b8-a2ac-d73d475f7c48 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
82992024-11-09T02:54:18.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fbe25f2-c51d-41b8-a2ac-d73d475f7c48 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83002024-11-09T02:54:18.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5fbe25f2-c51d-41b8-a2ac-d73d475f7c48 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83012024-11-09T02:54:19.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bbee651f-3f28-40e5-a2a9-9a830b883c4f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83022024-11-09T02:54:19.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bbee651f-3f28-40e5-a2a9-9a830b883c4f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83032024-11-09T02:54:19.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bbee651f-3f28-40e5-a2a9-9a830b883c4f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83042024-11-09T02:54:20.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0703477e-9a19-4d9e-a3ac-c604e317d0fe roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83052024-11-09T02:54:20.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0703477e-9a19-4d9e-a3ac-c604e317d0fe resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83062024-11-09T02:54:20.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0703477e-9a19-4d9e-a3ac-c604e317d0fe response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83072024-11-09T02:54:21.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ab5e20c-0c6d-47bb-87bf-2ed8ecae08da roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83082024-11-09T02:54:21.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ab5e20c-0c6d-47bb-87bf-2ed8ecae08da resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83092024-11-09T02:54:21.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ab5e20c-0c6d-47bb-87bf-2ed8ecae08da response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83102024-11-09T02:54:22.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 05f5712a-a404-43ef-b250-aaaa316e2dfc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83112024-11-09T02:54:22.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 05f5712a-a404-43ef-b250-aaaa316e2dfc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83122024-11-09T02:54:22.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 05f5712a-a404-43ef-b250-aaaa316e2dfc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83132024-11-09T02:54:23.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
83142024-11-09T02:54:23.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
83152024-11-09T02:54:23.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83162024-11-09T02:54:23.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83172024-11-09T02:54:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83182024-11-09T02:54:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83192024-11-09T02:54:23.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83202024-11-09T02:54:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83212024-11-09T02:54:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83222024-11-09T02:54:23.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.899121ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83232024-11-09T02:54:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83242024-11-09T02:54:23.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83252024-11-09T02:54:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83262024-11-09T02:54:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83272024-11-09T02:54:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83282024-11-09T02:54:23.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83292024-11-09T02:54:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
83302024-11-09T02:54:23.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83312024-11-09T02:54:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83322024-11-09T02:54:23.188ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
83332024-11-09T02:54:23.188ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.156085ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
83342024-11-09T02:54:24.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cff21696-5e95-42fe-a54a-bc00c25135c3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83352024-11-09T02:54:24.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cff21696-5e95-42fe-a54a-bc00c25135c3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83362024-11-09T02:54:24.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cff21696-5e95-42fe-a54a-bc00c25135c3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83372024-11-09T02:54:25.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ac6243c-81dd-426a-a2ba-a5c19384880f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83382024-11-09T02:54:25.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ac6243c-81dd-426a-a2ba-a5c19384880f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83392024-11-09T02:54:25.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ac6243c-81dd-426a-a2ba-a5c19384880f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83402024-11-09T02:54:26.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55f3127b-c4a0-4928-9d50-59a3338d4dd9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83412024-11-09T02:54:26.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55f3127b-c4a0-4928-9d50-59a3338d4dd9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83422024-11-09T02:54:26.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55f3127b-c4a0-4928-9d50-59a3338d4dd9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83432024-11-09T02:54:27.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f42a8abc-cecf-4047-8b8b-dacc5c2fc734 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83442024-11-09T02:54:27.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f42a8abc-cecf-4047-8b8b-dacc5c2fc734 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83452024-11-09T02:54:27.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f42a8abc-cecf-4047-8b8b-dacc5c2fc734 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83462024-11-09T02:54:28.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82e56a08-8638-443f-a945-be88d32bba15 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83472024-11-09T02:54:28.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82e56a08-8638-443f-a945-be88d32bba15 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83482024-11-09T02:54:28.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82e56a08-8638-443f-a945-be88d32bba15 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83492024-11-09T02:54:29.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dbb78579-ef55-4f27-b575-2875e0805a34 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83502024-11-09T02:54:29.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dbb78579-ef55-4f27-b575-2875e0805a34 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83512024-11-09T02:54:29.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dbb78579-ef55-4f27-b575-2875e0805a34 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83522024-11-09T02:54:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 578 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 2b747f87-8e8e-4679-bbc3-bb15873ad5f2 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
83532024-11-09T02:54:30.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea2fb1a7-6def-4738-a89b-dd91ab074543 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83542024-11-09T02:54:30.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea2fb1a7-6def-4738-a89b-dd91ab074543 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83552024-11-09T02:54:30.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea2fb1a7-6def-4738-a89b-dd91ab074543 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83562024-11-09T02:54:31.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d77115f9-77d0-4363-ba93-a535aab8aed8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83572024-11-09T02:54:31.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d77115f9-77d0-4363-ba93-a535aab8aed8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83582024-11-09T02:54:31.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d77115f9-77d0-4363-ba93-a535aab8aed8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83592024-11-09T02:54:32.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a6885c4-d9c1-4d40-9385-92aa5c019b89 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83602024-11-09T02:54:32.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a6885c4-d9c1-4d40-9385-92aa5c019b89 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83612024-11-09T02:54:32.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a6885c4-d9c1-4d40-9385-92aa5c019b89 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
83622024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
83632024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
83642024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
83652024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
83662024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83672024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
83682024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83692024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83702024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
83712024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
83722024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
83732024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83742024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83752024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
83762024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
83772024-11-09T02:54:33.169ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83782024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83792024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83802024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
83812024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
83822024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83832024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83842024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
83852024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
83862024-11-09T02:54:33.169ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:44:33.169327730 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
83872024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
83882024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
83892024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
83902024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
83912024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83922024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
83932024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
83942024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
83952024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83962024-11-09T02:54:33.169ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
83972024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83982024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.46\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
83992024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
84002024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84012024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
84022024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84032024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84042024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
84052024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84062024-11-09T02:54:33.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84072024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84082024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
84092024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84102024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
84112024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84122024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84132024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84142024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84152024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84162024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84172024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84182024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84192024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84202024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84212024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84222024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84232024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84242024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84252024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84262024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
84272024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
84282024-11-09T02:54:33.169ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
84292024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84302024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84312024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84322024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
84332024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
84342024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
84352024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84362024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84372024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
84382024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.961\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
84392024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.191\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
84402024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.27\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
84412024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.381\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84422024-11-09T02:54:33.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 507498256 } })
84432024-11-09T02:54:33.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 507529887 } })
84442024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84452024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84462024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
84472024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.532601ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
84482024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
84492024-11-09T02:54:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.760686ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
84502024-11-09T02:54:33.173ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84512024-11-09T02:54:33.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84522024-11-09T02:54:33.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.935222ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84532024-11-09T02:54:33.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84542024-11-09T02:54:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84552024-11-09T02:54:33.176ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84562024-11-09T02:54:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84572024-11-09T02:54:33.178ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 515523552 } })
84582024-11-09T02:54:33.178ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
84592024-11-09T02:54:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84602024-11-09T02:54:33.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84612024-11-09T02:54:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84622024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84632024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84642024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84652024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84662024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84672024-11-09T02:54:33.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84682024-11-09T02:54:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84692024-11-09T02:54:33.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84702024-11-09T02:54:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84712024-11-09T02:54:33.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84722024-11-09T02:54:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84732024-11-09T02:54:33.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84742024-11-09T02:54:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84752024-11-09T02:54:33.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 524832275 } })
84762024-11-09T02:54:33.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
84772024-11-09T02:54:33.189ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:44:33.169327730 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
84782024-11-09T02:54:33.189ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.137406ms iteration = 9 status = {"expiration":"2024-11-09T02:44:33.169327730Z","pruned":[]}
84792024-11-09T02:54:33.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84802024-11-09T02:54:33.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812024-11-09T02:54:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84822024-11-09T02:54:33.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84832024-11-09T02:54:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84842024-11-09T02:54:33.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84852024-11-09T02:54:33.192ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84862024-11-09T02:54:33.192ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84872024-11-09T02:54:33.192ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84882024-11-09T02:54:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84892024-11-09T02:54:33.193ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84902024-11-09T02:54:33.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84912024-11-09T02:54:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84922024-11-09T02:54:33.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84932024-11-09T02:54:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84942024-11-09T02:54:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84952024-11-09T02:54:33.200ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.331327ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
84962024-11-09T02:54:33.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84972024-11-09T02:54:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84982024-11-09T02:54:33.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84992024-11-09T02:54:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85002024-11-09T02:54:33.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85012024-11-09T02:54:33.205ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 542621412 } })
85022024-11-09T02:54:33.205ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
85032024-11-09T02:54:33.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85042024-11-09T02:54:33.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85052024-11-09T02:54:33.212ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85062024-11-09T02:54:33.212ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85072024-11-09T02:54:33.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85082024-11-09T02:54:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85092024-11-09T02:54:33.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85102024-11-09T02:54:33.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85112024-11-09T02:54:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85122024-11-09T02:54:33.217ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85132024-11-09T02:54:33.217ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.300849ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85142024-11-09T02:54:33.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85152024-11-09T02:54:33.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85162024-11-09T02:54:33.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85172024-11-09T02:54:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85182024-11-09T02:54:33.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1c5d0fdf-2cad-42ec-a382-150945a26566 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
85192024-11-09T02:54:33.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1c5d0fdf-2cad-42ec-a382-150945a26566 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
85202024-11-09T02:54:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85212024-11-09T02:54:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85222024-11-09T02:54:33.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1c5d0fdf-2cad-42ec-a382-150945a26566 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
85232024-11-09T02:54:33.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85242024-11-09T02:54:33.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85252024-11-09T02:54:33.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85262024-11-09T02:54:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
85272024-11-09T02:54:33.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85282024-11-09T02:54:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85292024-11-09T02:54:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85302024-11-09T02:54:33.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85312024-11-09T02:54:33.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85322024-11-09T02:54:33.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85332024-11-09T02:54:33.255ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85342024-11-09T02:54:33.255ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85352024-11-09T02:54:33.255ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 85.199781ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85362024-11-09T02:54:33.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85372024-11-09T02:54:33.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85382024-11-09T02:54:33.259ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85392024-11-09T02:54:33.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85402024-11-09T02:54:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85412024-11-09T02:54:33.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85422024-11-09T02:54:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85432024-11-09T02:54:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
85442024-11-09T02:54:33.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85452024-11-09T02:54:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85462024-11-09T02:54:33.267ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
85472024-11-09T02:54:33.268ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
85482024-11-09T02:54:33.268ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
85492024-11-09T02:54:33.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85502024-11-09T02:54:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85512024-11-09T02:54:33.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.222213ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85522024-11-09T02:54:33.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85532024-11-09T02:54:33.272ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85542024-11-09T02:54:33.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85552024-11-09T02:54:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85562024-11-09T02:54:33.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85572024-11-09T02:54:33.274ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
85582024-11-09T02:54:33.274ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.568982ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
85592024-11-09T02:54:33.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85602024-11-09T02:54:33.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85612024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85622024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85632024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85642024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85652024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85662024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85672024-11-09T02:54:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85682024-11-09T02:54:33.279ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
85692024-11-09T02:54:33.279ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
85702024-11-09T02:54:33.279ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.468614ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
85712024-11-09T02:54:33.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85722024-11-09T02:54:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85732024-11-09T02:54:33.281ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85742024-11-09T02:54:33.281ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85752024-11-09T02:54:33.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85762024-11-09T02:54:33.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85772024-11-09T02:54:33.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85782024-11-09T02:54:33.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85792024-11-09T02:54:33.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85802024-11-09T02:54:33.288ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
85812024-11-09T02:54:33.288ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 118.841105ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85822024-11-09T02:54:33.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85832024-11-09T02:54:33.291ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
85842024-11-09T02:54:33.291ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85852024-11-09T02:54:33.291ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
85862024-11-09T02:54:33.291ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 122.055083ms iteration = 9 status = {"generation":1}
85872024-11-09T02:54:33.291ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85882024-11-09T02:54:33.291ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85892024-11-09T02:54:33.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.111434ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85902024-11-09T02:54:33.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 131.784734ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85912024-11-09T02:54:33.307ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85922024-11-09T02:54:33.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
85932024-11-09T02:54:33.324ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85942024-11-09T02:54:33.324ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85952024-11-09T02:54:33.324ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85962024-11-09T02:54:33.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85972024-11-09T02:54:33.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85982024-11-09T02:54:33.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992024-11-09T02:54:33.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002024-11-09T02:54:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86012024-11-09T02:54:33.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86022024-11-09T02:54:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86032024-11-09T02:54:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
86042024-11-09T02:54:33.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86052024-11-09T02:54:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86062024-11-09T02:54:33.331ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
86072024-11-09T02:54:33.331ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86082024-11-09T02:54:33.331ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81bbfcd4-5f9b-42a1-8ded-1b54f72d3fbd", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86092024-11-09T02:54:33.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86102024-11-09T02:54:33.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86112024-11-09T02:54:33.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86122024-11-09T02:54:33.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86132024-11-09T02:54:33.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
86142024-11-09T02:54:33.355ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86152024-11-09T02:54:33.355ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9696ba95-8144-4171-9be0-d076d44b0805", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86162024-11-09T02:54:33.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86172024-11-09T02:54:33.358ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86182024-11-09T02:54:33.362ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
86192024-11-09T02:54:33.362ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86202024-11-09T02:54:33.362ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36cd7779-1d0c-4287-9e33-e772b238c492", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86212024-11-09T02:54:33.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86222024-11-09T02:54:33.363ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86232024-11-09T02:54:33.363ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.444438ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86242024-11-09T02:54:33.365ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
86252024-11-09T02:54:33.372ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
86262024-11-09T02:54:33.372ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
86272024-11-09T02:54:33.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86282024-11-09T02:54:33.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86292024-11-09T02:54:33.405ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 236.66587ms iteration = 19 status = {"physical_disks_added":0}
86302024-11-09T02:54:33.454ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86312024-11-09T02:54:33.511ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86322024-11-09T02:54:33.512ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ab4d35-d407-4d07-8063-f93c656f5bda", "content-length": "1", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86332024-11-09T02:54:33.514ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86342024-11-09T02:54:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86352024-11-09T02:54:33.517ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 348.046273ms iteration = 17 status = {}
86362024-11-09T02:54:33.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86372024-11-09T02:54:33.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3e24daa2-9cab-41b0-9291-7a28a8b9dd61", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86382024-11-09T02:54:33.587ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86392024-11-09T02:54:33.589ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9bb28422-e104-4ce5-9fbd-c0b2c7200052", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86402024-11-09T02:54:33.589ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86412024-11-09T02:54:33.591ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5286d297-c9e3-404b-8069-54cfcf41de3f", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86422024-11-09T02:54:33.591ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86432024-11-09T02:54:33.593ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86442024-11-09T02:54:33.593ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 424.35755ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86452024-11-09T02:54:33.613ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
86462024-11-09T02:54:33.613ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86472024-11-09T02:54:33.613ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86482024-11-09T02:54:33.614ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "49111c3d-5fce-4e68-ac23-835643197f6b", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86492024-11-09T02:54:33.614ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86502024-11-09T02:54:33.615ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 446.464446ms iteration = 17 status = 0
86512024-11-09T02:54:33.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86522024-11-09T02:54:33.616ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6678593c-1460-47ef-90ed-ece4716d03af", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86532024-11-09T02:54:33.616ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86542024-11-09T02:54:33.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86552024-11-09T02:54:33.617ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.221193ms iteration = 17 status = null
86562024-11-09T02:54:33.618ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86572024-11-09T02:54:33.618ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 449.016709ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
86582024-11-09T02:54:33.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86592024-11-09T02:54:33.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86602024-11-09T02:54:33.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86612024-11-09T02:54:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86622024-11-09T02:54:33.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86632024-11-09T02:54:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86642024-11-09T02:54:33.621ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86652024-11-09T02:54:33.622ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
86662024-11-09T02:54:33.622ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86672024-11-09T02:54:33.622ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
86682024-11-09T02:54:33.622ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 453.052492ms iteration = 9 status = {"generation":2}
86692024-11-09T02:54:33.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86702024-11-09T02:54:33.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86712024-11-09T02:54:33.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86722024-11-09T02:54:33.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86732024-11-09T02:54:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86742024-11-09T02:54:33.684ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86752024-11-09T02:54:33.686ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
86762024-11-09T02:54:33.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86772024-11-09T02:54:33.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86782024-11-09T02:54:33.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86792024-11-09T02:54:33.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eb2538f-29b5-4e4a-bced-2f99e374f99a", "content-length": "134", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86802024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86812024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
86822024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86832024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86842024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86852024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86862024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86872024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86882024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86892024-11-09T02:54:33.699ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86902024-11-09T02:54:33.700ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
86912024-11-09T02:54:33.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86922024-11-09T02:54:33.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86932024-11-09T02:54:33.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86942024-11-09T02:54:33.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "453b3860-0873-46b9-ba5f-89b4e8fa34e2", "content-length": "2", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86952024-11-09T02:54:33.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86962024-11-09T02:54:33.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "61b3988e-1719-472f-b981-9241652e533d", "content-length": "52", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
86972024-11-09T02:54:33.702ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
86982024-11-09T02:54:33.702ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86992024-11-09T02:54:33.727ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "658ae5ed-c129-438b-b292-0f0cf224ffbe", "content-length": "372", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
87002024-11-09T02:54:33.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87012024-11-09T02:54:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87022024-11-09T02:54:33.733ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8d0a4a5-710e-4e4a-9c78-c0e9909598f9", "content-length": "691", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
87032024-11-09T02:54:33.733ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
87042024-11-09T02:54:33.733ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87052024-11-09T02:54:33.733ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87062024-11-09T02:54:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 565.730181ms iteration = 17 status = {}
87072024-11-09T02:54:33.741ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87082024-11-09T02:54:33.741ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87092024-11-09T02:54:33.741ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe9594be-a0eb-4eaa-8383-6f1544e05b8f", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
87102024-11-09T02:54:33.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87112024-11-09T02:54:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87122024-11-09T02:54:33.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87132024-11-09T02:54:33.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87142024-11-09T02:54:33.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87152024-11-09T02:54:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87162024-11-09T02:54:33.749ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87172024-11-09T02:54:33.749ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87182024-11-09T02:54:33.750ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0102c6c-3a09-43eb-bb83-743baf980daa", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
87192024-11-09T02:54:33.751ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 582.542508ms iteration = 17 status = {}
87202024-11-09T02:54:33.837ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "62a1ffd5-55c7-47f8-923b-d1fbc8fe1f53", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
87212024-11-09T02:54:33.837ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
87222024-11-09T02:54:33.837ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87232024-11-09T02:54:33.842ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "059917e1-4415-4013-b014-32a0f9400edb", "content-length": "682", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
87242024-11-09T02:54:33.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87252024-11-09T02:54:33.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87262024-11-09T02:54:33.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87272024-11-09T02:54:33.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87282024-11-09T02:54:33.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87292024-11-09T02:54:33.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87302024-11-09T02:54:33.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87312024-11-09T02:54:33.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87322024-11-09T02:54:33.858ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.724104ms iteration = 17 status = {}
87332024-11-09T02:54:34.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 9f98f8c5-a2ee-4738-92d4-27e1c1a648aa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
87342024-11-09T02:54:34.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 9f98f8c5-a2ee-4738-92d4-27e1c1a648aa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
87352024-11-09T02:54:34.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 9f98f8c5-a2ee-4738-92d4-27e1c1a648aa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
87362024-11-09T02:54:34.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce095879-4b12-4459-9ad7-1c6481a3b55d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87372024-11-09T02:54:34.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce095879-4b12-4459-9ad7-1c6481a3b55d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87382024-11-09T02:54:34.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce095879-4b12-4459-9ad7-1c6481a3b55d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87392024-11-09T02:54:35.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95c3d63d-ba56-4f5c-876c-8f6f51cca437 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87402024-11-09T02:54:35.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95c3d63d-ba56-4f5c-876c-8f6f51cca437 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87412024-11-09T02:54:35.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 95c3d63d-ba56-4f5c-876c-8f6f51cca437 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87422024-11-09T02:54:36.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b90c4602-038d-4bc6-b0e6-0cf71e198496 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87432024-11-09T02:54:36.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b90c4602-038d-4bc6-b0e6-0cf71e198496 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87442024-11-09T02:54:36.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b90c4602-038d-4bc6-b0e6-0cf71e198496 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87452024-11-09T02:54:37.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0620dc1c-b2a1-4ad1-b3b8-9258bc258fb5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87462024-11-09T02:54:37.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0620dc1c-b2a1-4ad1-b3b8-9258bc258fb5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87472024-11-09T02:54:37.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0620dc1c-b2a1-4ad1-b3b8-9258bc258fb5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87482024-11-09T02:54:38.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d73a13ce-3020-4f31-9028-1a5576569b85 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87492024-11-09T02:54:38.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d73a13ce-3020-4f31-9028-1a5576569b85 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87502024-11-09T02:54:38.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d73a13ce-3020-4f31-9028-1a5576569b85 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87512024-11-09T02:54:39.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dd1707bf-e1fe-48a7-8bac-2942c6a2bc50 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87522024-11-09T02:54:39.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dd1707bf-e1fe-48a7-8bac-2942c6a2bc50 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87532024-11-09T02:54:39.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dd1707bf-e1fe-48a7-8bac-2942c6a2bc50 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87542024-11-09T02:54:40.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 901376d0-4fe8-4465-ab0f-6b447a5d2002 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87552024-11-09T02:54:40.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 901376d0-4fe8-4465-ab0f-6b447a5d2002 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87562024-11-09T02:54:40.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 901376d0-4fe8-4465-ab0f-6b447a5d2002 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87572024-11-09T02:54:41.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 184d7960-588f-4094-94a5-891693e49370 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87582024-11-09T02:54:41.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 184d7960-588f-4094-94a5-891693e49370 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87592024-11-09T02:54:41.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 184d7960-588f-4094-94a5-891693e49370 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87602024-11-09T02:54:42.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea0cdaaf-9863-47fa-b01b-41665879c818 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87612024-11-09T02:54:42.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea0cdaaf-9863-47fa-b01b-41665879c818 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87622024-11-09T02:54:42.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea0cdaaf-9863-47fa-b01b-41665879c818 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87632024-11-09T02:54:43.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
87642024-11-09T02:54:43.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
87652024-11-09T02:54:43.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87662024-11-09T02:54:43.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87672024-11-09T02:54:43.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87682024-11-09T02:54:43.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87692024-11-09T02:54:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87702024-11-09T02:54:43.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87712024-11-09T02:54:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87722024-11-09T02:54:43.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.645116ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87732024-11-09T02:54:43.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87742024-11-09T02:54:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87752024-11-09T02:54:43.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87762024-11-09T02:54:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87772024-11-09T02:54:43.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87782024-11-09T02:54:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87792024-11-09T02:54:43.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
87802024-11-09T02:54:43.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87812024-11-09T02:54:43.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87822024-11-09T02:54:43.187ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
87832024-11-09T02:54:43.187ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.669496ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
87842024-11-09T02:54:43.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9f53926-4cf1-482c-bc67-8322675f1002 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87852024-11-09T02:54:43.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9f53926-4cf1-482c-bc67-8322675f1002 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87862024-11-09T02:54:43.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9f53926-4cf1-482c-bc67-8322675f1002 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87872024-11-09T02:54:44.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9acf6a0-0191-4240-b96f-8dc2d2557873 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87882024-11-09T02:54:44.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9acf6a0-0191-4240-b96f-8dc2d2557873 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87892024-11-09T02:54:44.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d9acf6a0-0191-4240-b96f-8dc2d2557873 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87902024-11-09T02:54:45.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 923 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = cf6f9324-ca78-4e93-a4d7-ba13cffd473e response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
87912024-11-09T02:54:45.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 24a9c62b-498b-4812-8a84-0a3b0e768658 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87922024-11-09T02:54:45.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 24a9c62b-498b-4812-8a84-0a3b0e768658 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87932024-11-09T02:54:45.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 24a9c62b-498b-4812-8a84-0a3b0e768658 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87942024-11-09T02:54:46.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aac60406-a103-4bc1-a054-652538e31ad3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87952024-11-09T02:54:46.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aac60406-a103-4bc1-a054-652538e31ad3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87962024-11-09T02:54:46.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aac60406-a103-4bc1-a054-652538e31ad3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87972024-11-09T02:54:47.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b7a36c5-4a4c-42b6-bb1d-38b1a7402d7a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87982024-11-09T02:54:47.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b7a36c5-4a4c-42b6-bb1d-38b1a7402d7a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
87992024-11-09T02:54:47.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b7a36c5-4a4c-42b6-bb1d-38b1a7402d7a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88002024-11-09T02:54:48.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2bf122e5-6e89-4440-a069-110e6466f8c9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88012024-11-09T02:54:48.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2bf122e5-6e89-4440-a069-110e6466f8c9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88022024-11-09T02:54:48.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2bf122e5-6e89-4440-a069-110e6466f8c9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88032024-11-09T02:54:49.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06c628df-a6d7-4f71-98fe-384c50b1c728 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88042024-11-09T02:54:49.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06c628df-a6d7-4f71-98fe-384c50b1c728 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88052024-11-09T02:54:49.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06c628df-a6d7-4f71-98fe-384c50b1c728 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88062024-11-09T02:54:50.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f8544de8-3661-4fad-9992-9fa19bceb781 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88072024-11-09T02:54:50.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f8544de8-3661-4fad-9992-9fa19bceb781 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88082024-11-09T02:54:50.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f8544de8-3661-4fad-9992-9fa19bceb781 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88092024-11-09T02:54:51.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b40342fc-4865-47fa-bcf6-6b95ff96663c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88102024-11-09T02:54:51.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b40342fc-4865-47fa-bcf6-6b95ff96663c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88112024-11-09T02:54:51.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b40342fc-4865-47fa-bcf6-6b95ff96663c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88122024-11-09T02:54:52.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6d430fbc-987f-49ac-948b-08a8674d22d1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88132024-11-09T02:54:52.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6d430fbc-987f-49ac-948b-08a8674d22d1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88142024-11-09T02:54:52.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6d430fbc-987f-49ac-948b-08a8674d22d1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88152024-11-09T02:54:53.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
88162024-11-09T02:54:53.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
88172024-11-09T02:54:53.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88182024-11-09T02:54:53.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88192024-11-09T02:54:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88202024-11-09T02:54:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88212024-11-09T02:54:53.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88222024-11-09T02:54:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88232024-11-09T02:54:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88242024-11-09T02:54:53.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.85076ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88252024-11-09T02:54:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88262024-11-09T02:54:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88272024-11-09T02:54:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88282024-11-09T02:54:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88292024-11-09T02:54:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88302024-11-09T02:54:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312024-11-09T02:54:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
88322024-11-09T02:54:53.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88332024-11-09T02:54:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88342024-11-09T02:54:53.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
88352024-11-09T02:54:53.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.366971ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
88362024-11-09T02:54:53.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 24113d54-b2b1-4fd3-bd85-85d232ab1f78 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88372024-11-09T02:54:53.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 24113d54-b2b1-4fd3-bd85-85d232ab1f78 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88382024-11-09T02:54:53.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 24113d54-b2b1-4fd3-bd85-85d232ab1f78 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88392024-11-09T02:54:54.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b49d898f-68a6-4310-9a59-31a9db4fdee1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88402024-11-09T02:54:54.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b49d898f-68a6-4310-9a59-31a9db4fdee1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88412024-11-09T02:54:54.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b49d898f-68a6-4310-9a59-31a9db4fdee1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88422024-11-09T02:54:55.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 987ff4d1-14b8-4831-8595-edfbba0550d7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88432024-11-09T02:54:55.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 987ff4d1-14b8-4831-8595-edfbba0550d7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88442024-11-09T02:54:55.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 987ff4d1-14b8-4831-8595-edfbba0550d7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88452024-11-09T02:54:56.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 00ce484a-026e-482e-923f-4c523cc761bc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88462024-11-09T02:54:56.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 00ce484a-026e-482e-923f-4c523cc761bc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88472024-11-09T02:54:56.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 00ce484a-026e-482e-923f-4c523cc761bc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88482024-11-09T02:54:57.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b8ae94cc-4086-4e88-a58f-0d7044743028 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88492024-11-09T02:54:57.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b8ae94cc-4086-4e88-a58f-0d7044743028 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88502024-11-09T02:54:57.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b8ae94cc-4086-4e88-a58f-0d7044743028 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88512024-11-09T02:54:58.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4ec68f56-6757-4f99-b674-46a1e0ffbf61 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88522024-11-09T02:54:58.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4ec68f56-6757-4f99-b674-46a1e0ffbf61 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88532024-11-09T02:54:58.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4ec68f56-6757-4f99-b674-46a1e0ffbf61 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88542024-11-09T02:54:59.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de858ad2-0887-42b1-86f8-23972bffd293 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88552024-11-09T02:54:59.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de858ad2-0887-42b1-86f8-23972bffd293 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88562024-11-09T02:54:59.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de858ad2-0887-42b1-86f8-23972bffd293 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88572024-11-09T02:55:00.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 592 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 8b86a36f-8348-4c93-882d-a5ec110bfcef response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
88582024-11-09T02:55:00.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1582d47b-b5fe-4c56-b8c2-d90ad95bf484 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88592024-11-09T02:55:00.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1582d47b-b5fe-4c56-b8c2-d90ad95bf484 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88602024-11-09T02:55:00.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1582d47b-b5fe-4c56-b8c2-d90ad95bf484 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88612024-11-09T02:55:01.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c0848d1c-bd8a-455e-9023-5621f501d57a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88622024-11-09T02:55:01.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c0848d1c-bd8a-455e-9023-5621f501d57a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88632024-11-09T02:55:01.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c0848d1c-bd8a-455e-9023-5621f501d57a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88642024-11-09T02:55:02.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dd6f57ff-87ea-4540-bfa7-04c1b08c6392 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88652024-11-09T02:55:02.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dd6f57ff-87ea-4540-bfa7-04c1b08c6392 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88662024-11-09T02:55:02.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dd6f57ff-87ea-4540-bfa7-04c1b08c6392 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
88672024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
88682024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88692024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
88702024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88712024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
88722024-11-09T02:55:03.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88732024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
88742024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88752024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
88762024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88772024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88782024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
88792024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88802024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88812024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
88822024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88832024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
88842024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
88852024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88862024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88872024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
88882024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
88892024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88902024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88912024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
88922024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
88932024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88942024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88952024-11-09T02:55:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88962024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88972024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88982024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88992024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89002024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89012024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89022024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89032024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89042024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89052024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89062024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
89072024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.231\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89082024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
89092024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
89102024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.95\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
89112024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.66\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89122024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
89132024-11-09T02:55:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.01\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
89142024-11-09T02:55:03.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89152024-11-09T02:55:03.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89162024-11-09T02:55:03.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89172024-11-09T02:55:03.173ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.662956ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89182024-11-09T02:55:03.174ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 511718934 } })
89192024-11-09T02:55:03.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
89202024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89212024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89222024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89232024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89242024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89252024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89262024-11-09T02:55:03.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89272024-11-09T02:55:03.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89282024-11-09T02:55:03.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89292024-11-09T02:55:03.183ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89302024-11-09T02:55:03.184ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 521245251 } })
89312024-11-09T02:55:03.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89322024-11-09T02:55:03.184ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
89332024-11-09T02:55:03.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89342024-11-09T02:55:03.185ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89352024-11-09T02:55:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89362024-11-09T02:55:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89372024-11-09T02:55:03.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89382024-11-09T02:55:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89392024-11-09T02:55:03.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89402024-11-09T02:55:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89412024-11-09T02:55:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89422024-11-09T02:55:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89432024-11-09T02:55:03.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89442024-11-09T02:55:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89452024-11-09T02:55:03.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89462024-11-09T02:55:03.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 21.586956ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89472024-11-09T02:55:03.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89482024-11-09T02:55:03.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89492024-11-09T02:55:03.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89502024-11-09T02:55:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89512024-11-09T02:55:03.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89522024-11-09T02:55:03.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89532024-11-09T02:55:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89542024-11-09T02:55:03.195ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 532552154 } })
89552024-11-09T02:55:03.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89562024-11-09T02:55:03.195ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89572024-11-09T02:55:03.195ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
89582024-11-09T02:55:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89592024-11-09T02:55:03.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89602024-11-09T02:55:03.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
89612024-11-09T02:55:03.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89622024-11-09T02:55:03.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89632024-11-09T02:55:03.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89642024-11-09T02:55:03.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89652024-11-09T02:55:03.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89662024-11-09T02:55:03.218ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89672024-11-09T02:55:03.218ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89682024-11-09T02:55:03.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89692024-11-09T02:55:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89702024-11-09T02:55:03.221ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
89712024-11-09T02:55:03.221ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.729519ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
89722024-11-09T02:55:03.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89732024-11-09T02:55:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89742024-11-09T02:55:03.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89752024-11-09T02:55:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89762024-11-09T02:55:03.227ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89772024-11-09T02:55:03.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89782024-11-09T02:55:03.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89792024-11-09T02:55:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
89802024-11-09T02:55:03.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89812024-11-09T02:55:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89822024-11-09T02:55:03.233ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.985873ms iteration = 18 status = 0
89832024-11-09T02:55:03.237ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89842024-11-09T02:55:03.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.522536ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89852024-11-09T02:55:03.243ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
89862024-11-09T02:55:03.243ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89872024-11-09T02:55:03.243ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe2caad9-4f6b-418d-af0d-45161cc76e19", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
89882024-11-09T02:55:03.244ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89892024-11-09T02:55:03.245ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89902024-11-09T02:55:03.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89912024-11-09T02:55:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89922024-11-09T02:55:03.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89932024-11-09T02:55:03.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89942024-11-09T02:55:03.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89952024-11-09T02:55:03.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.99607ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89962024-11-09T02:55:03.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89972024-11-09T02:55:03.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89982024-11-09T02:55:03.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89992024-11-09T02:55:03.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90002024-11-09T02:55:03.263ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90012024-11-09T02:55:03.263ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90022024-11-09T02:55:03.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90032024-11-09T02:55:03.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90042024-11-09T02:55:03.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90052024-11-09T02:55:03.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90062024-11-09T02:55:03.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90072024-11-09T02:55:03.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
90082024-11-09T02:55:03.267ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90092024-11-09T02:55:03.268ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "235a6e94-14a3-460c-8d66-f480f9692e39", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
90102024-11-09T02:55:03.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90112024-11-09T02:55:03.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90122024-11-09T02:55:03.277ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
90132024-11-09T02:55:03.277ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90142024-11-09T02:55:03.277ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d36a1566-e201-4381-8951-06e04d0af0aa", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
90152024-11-09T02:55:03.277ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90162024-11-09T02:55:03.279ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
90172024-11-09T02:55:03.308ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90182024-11-09T02:55:03.308ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90192024-11-09T02:55:03.308ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.951622ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90202024-11-09T02:55:03.316ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.196682ms iteration = 20 status = {"physical_disks_added":0}
90212024-11-09T02:55:03.357ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90222024-11-09T02:55:03.357ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fccb525b-ccb6-4fc0-ac96-ddd90c159b4e", "content-length": "1", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
90232024-11-09T02:55:03.358ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90242024-11-09T02:55:03.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90252024-11-09T02:55:03.360ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 191.053739ms iteration = 18 status = null
90262024-11-09T02:55:03.388ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.906913ms iteration = 18 status = {}
90272024-11-09T02:55:03.390ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90282024-11-09T02:55:03.390ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8670ea8c-2386-4d88-9850-b1545425c6b8", "content-length": "691", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
90292024-11-09T02:55:03.390ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90302024-11-09T02:55:03.390ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90312024-11-09T02:55:03.390ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90322024-11-09T02:55:03.390ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90332024-11-09T02:55:03.390ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90342024-11-09T02:55:03.390ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "793e6ffe-a912-4d76-be82-28b61058c1ef", "content-length": "372", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
90352024-11-09T02:55:03.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90362024-11-09T02:55:03.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90372024-11-09T02:55:03.392ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 222.936237ms iteration = 18 status = {}
90382024-11-09T02:55:03.405ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
90392024-11-09T02:55:03.405ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90402024-11-09T02:55:03.405ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b2c2576a-1433-49ce-8255-ddfe80eeade2", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
90412024-11-09T02:55:03.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90422024-11-09T02:55:03.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90432024-11-09T02:55:03.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90442024-11-09T02:55:03.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90452024-11-09T02:55:03.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90462024-11-09T02:55:03.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90472024-11-09T02:55:03.414ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90482024-11-09T02:55:03.414ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90492024-11-09T02:55:03.414ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e0373a70-68bc-44e3-a0d8-7b48be290f29", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
90502024-11-09T02:55:03.415ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 246.419142ms iteration = 18 status = {}
90512024-11-09T02:55:03.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90522024-11-09T02:55:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90532024-11-09T02:55:03.458ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
90542024-11-09T02:55:03.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90552024-11-09T02:55:03.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90562024-11-09T02:55:03.467ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90572024-11-09T02:55:03.467ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fba32858-b385-4298-a31b-47bce0742b53", "content-length": "134", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
90582024-11-09T02:55:03.467ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90592024-11-09T02:55:03.467ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
90602024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90612024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90622024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90632024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90642024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90652024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90662024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90672024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90682024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
90692024-11-09T02:55:03.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90702024-11-09T02:55:03.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90712024-11-09T02:55:03.470ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90722024-11-09T02:55:03.470ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a696ed10-fe49-4914-9a46-038efbca8402", "content-length": "2", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
90732024-11-09T02:55:03.470ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90742024-11-09T02:55:03.470ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b40dcbd-eb76-4eb6-ae19-b3bcd3841284", "content-length": "52", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
90752024-11-09T02:55:03.470ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
90762024-11-09T02:55:03.470ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90772024-11-09T02:55:03.672ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5ce5c92a-6b09-4822-9b51-5ed55d2b1a19", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
90782024-11-09T02:55:03.673ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
90792024-11-09T02:55:03.673ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90802024-11-09T02:55:03.677ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d14fa860-f4a9-4075-864f-c05ca1df0914", "content-length": "682", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
90812024-11-09T02:55:03.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90822024-11-09T02:55:03.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90832024-11-09T02:55:03.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90842024-11-09T02:55:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90852024-11-09T02:55:03.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90862024-11-09T02:55:03.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90872024-11-09T02:55:03.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90882024-11-09T02:55:03.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90892024-11-09T02:55:03.693ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 524.286315ms iteration = 18 status = {}
90902024-11-09T02:55:03.886ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
90912024-11-09T02:55:03.887ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
90922024-11-09T02:55:03.916ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
90932024-11-09T02:55:03.916ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:43858
90942024-11-09T02:55:03.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43858 req_id = fd26706f-1f7a-4757-8c85-89efc776b956 roles = RoleSet { roles: {} } uri = /metrics/producers
90952024-11-09T02:55:03.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43858 req_id = fd26706f-1f7a-4757-8c85-89efc776b956 resource = Database result = Ok(()) uri = /metrics/producers
90962024-11-09T02:55:03.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a2a8ec40-6e0b-49e4-a66b-1883a39078bd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
90972024-11-09T02:55:03.958ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
90982024-11-09T02:55:03.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41299 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43858 req_id = fd26706f-1f7a-4757-8c85-89efc776b956 response_code = 201 uri = /metrics/producers
90992024-11-09T02:55:03.958ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "fd26706f-1f7a-4757-8c85-89efc776b956", "content-length": "41", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
91002024-11-09T02:55:03.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a2a8ec40-6e0b-49e4-a66b-1883a39078bd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91012024-11-09T02:55:03.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a2a8ec40-6e0b-49e4-a66b-1883a39078bd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91022024-11-09T02:55:03.960ZDEBGnexus (producer-registration-task): registered with nexus successfully
91032024-11-09T02:55:03.960ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
91042024-11-09T02:55:04.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 216e9575-e3a7-4767-8c4f-701779c38055 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91052024-11-09T02:55:04.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 216e9575-e3a7-4767-8c4f-701779c38055 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91062024-11-09T02:55:04.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 216e9575-e3a7-4767-8c4f-701779c38055 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91072024-11-09T02:55:04.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b885a2d-1329-46c7-b498-46d277bc8113 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91082024-11-09T02:55:04.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b885a2d-1329-46c7-b498-46d277bc8113 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91092024-11-09T02:55:04.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b885a2d-1329-46c7-b498-46d277bc8113 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91102024-11-09T02:55:06.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22862034-09f5-4534-b8bb-3cecac532512 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91112024-11-09T02:55:06.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22862034-09f5-4534-b8bb-3cecac532512 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91122024-11-09T02:55:06.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22862034-09f5-4534-b8bb-3cecac532512 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91132024-11-09T02:55:07.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90104d2e-443a-4e5d-8f9c-ec6b613f93ed roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91142024-11-09T02:55:07.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90104d2e-443a-4e5d-8f9c-ec6b613f93ed resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91152024-11-09T02:55:07.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90104d2e-443a-4e5d-8f9c-ec6b613f93ed response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91162024-11-09T02:55:08.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7395fefa-7b39-495f-ac21-ccea60892c6a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91172024-11-09T02:55:08.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7395fefa-7b39-495f-ac21-ccea60892c6a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91182024-11-09T02:55:08.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7395fefa-7b39-495f-ac21-ccea60892c6a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91192024-11-09T02:55:09.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 204b26d5-f341-47f6-acb2-80669674ab3c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91202024-11-09T02:55:09.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 204b26d5-f341-47f6-acb2-80669674ab3c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91212024-11-09T02:55:09.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 204b26d5-f341-47f6-acb2-80669674ab3c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91222024-11-09T02:55:10.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5bac4e34-3171-447e-8241-e4491c61df83 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91232024-11-09T02:55:10.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5bac4e34-3171-447e-8241-e4491c61df83 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91242024-11-09T02:55:10.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5bac4e34-3171-447e-8241-e4491c61df83 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91252024-11-09T02:55:11.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f79914b6-d684-4f14-9382-5abd9f67dc24 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91262024-11-09T02:55:11.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f79914b6-d684-4f14-9382-5abd9f67dc24 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91272024-11-09T02:55:11.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f79914b6-d684-4f14-9382-5abd9f67dc24 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91282024-11-09T02:55:12.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0244540e-7646-41e2-96d5-7b0e2497d716 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91292024-11-09T02:55:12.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0244540e-7646-41e2-96d5-7b0e2497d716 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91302024-11-09T02:55:12.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0244540e-7646-41e2-96d5-7b0e2497d716 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91312024-11-09T02:55:13.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
91322024-11-09T02:55:13.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
91332024-11-09T02:55:13.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91342024-11-09T02:55:13.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91352024-11-09T02:55:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91362024-11-09T02:55:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91372024-11-09T02:55:13.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91382024-11-09T02:55:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91392024-11-09T02:55:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91402024-11-09T02:55:13.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 902ea3a1-937d-4bc8-89d9-9e6097297d8e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91412024-11-09T02:55:13.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 902ea3a1-937d-4bc8-89d9-9e6097297d8e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91422024-11-09T02:55:13.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.791349ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91432024-11-09T02:55:13.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91442024-11-09T02:55:13.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91452024-11-09T02:55:13.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91462024-11-09T02:55:13.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 902ea3a1-937d-4bc8-89d9-9e6097297d8e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91472024-11-09T02:55:13.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91482024-11-09T02:55:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91492024-11-09T02:55:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91502024-11-09T02:55:13.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
91512024-11-09T02:55:13.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91522024-11-09T02:55:13.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91532024-11-09T02:55:13.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
91542024-11-09T02:55:13.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.312901ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
91552024-11-09T02:55:14.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f67d08c8-b10a-4352-b24c-51d94ffc4b57 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91562024-11-09T02:55:14.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f67d08c8-b10a-4352-b24c-51d94ffc4b57 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91572024-11-09T02:55:14.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f67d08c8-b10a-4352-b24c-51d94ffc4b57 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91582024-11-09T02:55:15.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 836 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 4282609f-7c3e-4884-a3ba-427de34644d0 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
91592024-11-09T02:55:15.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20b919c9-3e35-43be-a575-f466443f2c6c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91602024-11-09T02:55:15.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20b919c9-3e35-43be-a575-f466443f2c6c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91612024-11-09T02:55:15.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20b919c9-3e35-43be-a575-f466443f2c6c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91622024-11-09T02:55:16.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4611c19a-e24b-4136-8d76-069fed731dd8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91632024-11-09T02:55:16.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4611c19a-e24b-4136-8d76-069fed731dd8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91642024-11-09T02:55:16.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4611c19a-e24b-4136-8d76-069fed731dd8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91652024-11-09T02:55:17.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46742ce2-6edf-41e0-9eca-5da3c328fed1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91662024-11-09T02:55:17.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46742ce2-6edf-41e0-9eca-5da3c328fed1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91672024-11-09T02:55:17.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46742ce2-6edf-41e0-9eca-5da3c328fed1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91682024-11-09T02:55:18.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fc9b93df-e082-4c4f-aef7-edd6947db654 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91692024-11-09T02:55:18.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fc9b93df-e082-4c4f-aef7-edd6947db654 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91702024-11-09T02:55:18.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fc9b93df-e082-4c4f-aef7-edd6947db654 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91712024-11-09T02:55:19.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 00f1b9ce-24df-4268-833d-6da08946a26f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91722024-11-09T02:55:19.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 00f1b9ce-24df-4268-833d-6da08946a26f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91732024-11-09T02:55:19.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 00f1b9ce-24df-4268-833d-6da08946a26f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91742024-11-09T02:55:20.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20034f1e-248e-443f-b942-aadf6f33de78 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91752024-11-09T02:55:20.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20034f1e-248e-443f-b942-aadf6f33de78 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91762024-11-09T02:55:20.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 20034f1e-248e-443f-b942-aadf6f33de78 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91772024-11-09T02:55:21.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5664fb6-5bfb-471c-92a5-bff9c860f1c7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91782024-11-09T02:55:21.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5664fb6-5bfb-471c-92a5-bff9c860f1c7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91792024-11-09T02:55:21.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d5664fb6-5bfb-471c-92a5-bff9c860f1c7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91802024-11-09T02:55:22.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 92cc0bd1-74b2-431a-8a18-69d8396e4aa0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91812024-11-09T02:55:22.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 92cc0bd1-74b2-431a-8a18-69d8396e4aa0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91822024-11-09T02:55:22.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 92cc0bd1-74b2-431a-8a18-69d8396e4aa0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
91832024-11-09T02:55:23.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
91842024-11-09T02:55:23.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
91852024-11-09T02:55:23.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91862024-11-09T02:55:23.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91872024-11-09T02:55:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91882024-11-09T02:55:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91892024-11-09T02:55:23.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91902024-11-09T02:55:23.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91912024-11-09T02:55:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91922024-11-09T02:55:23.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.016763ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91932024-11-09T02:55:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91942024-11-09T02:55:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91952024-11-09T02:55:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91962024-11-09T02:55:23.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91972024-11-09T02:55:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91982024-11-09T02:55:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992024-11-09T02:55:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
92002024-11-09T02:55:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92012024-11-09T02:55:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92022024-11-09T02:55:23.186ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
92032024-11-09T02:55:23.186ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.630564ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
92042024-11-09T02:55:23.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39dcc3f3-7112-44e1-898e-93644fccbe14 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92052024-11-09T02:55:23.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39dcc3f3-7112-44e1-898e-93644fccbe14 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92062024-11-09T02:55:23.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 39dcc3f3-7112-44e1-898e-93644fccbe14 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92072024-11-09T02:55:24.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1dd15707-85e9-4b00-940a-4a3987a5e6c8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92082024-11-09T02:55:24.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1dd15707-85e9-4b00-940a-4a3987a5e6c8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92092024-11-09T02:55:24.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1dd15707-85e9-4b00-940a-4a3987a5e6c8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92102024-11-09T02:55:25.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1a98e34-595f-4d97-be34-cf672de18807 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92112024-11-09T02:55:25.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1a98e34-595f-4d97-be34-cf672de18807 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92122024-11-09T02:55:25.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1a98e34-595f-4d97-be34-cf672de18807 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92132024-11-09T02:55:26.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cf5973fd-38e3-4a65-b47d-9514c4325ed3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92142024-11-09T02:55:26.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cf5973fd-38e3-4a65-b47d-9514c4325ed3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92152024-11-09T02:55:26.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cf5973fd-38e3-4a65-b47d-9514c4325ed3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92162024-11-09T02:55:27.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d56bdd4a-e90c-41f0-b628-77616cdae870 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92172024-11-09T02:55:27.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d56bdd4a-e90c-41f0-b628-77616cdae870 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92182024-11-09T02:55:27.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d56bdd4a-e90c-41f0-b628-77616cdae870 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92192024-11-09T02:55:28.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3edfb850-5408-417d-8944-e67ba57b3faa roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92202024-11-09T02:55:28.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3edfb850-5408-417d-8944-e67ba57b3faa resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92212024-11-09T02:55:28.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3edfb850-5408-417d-8944-e67ba57b3faa response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92222024-11-09T02:55:29.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a3873e6-11eb-44c6-aa6d-10dcfcdc6f9f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92232024-11-09T02:55:29.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a3873e6-11eb-44c6-aa6d-10dcfcdc6f9f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92242024-11-09T02:55:29.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a3873e6-11eb-44c6-aa6d-10dcfcdc6f9f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92252024-11-09T02:55:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 952 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 786a16d2-08b0-4ae9-ad17-02720281adf0 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
92262024-11-09T02:55:30.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2c1147fe-b7f3-44e0-bb81-f0308e8aabd2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92272024-11-09T02:55:30.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2c1147fe-b7f3-44e0-bb81-f0308e8aabd2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92282024-11-09T02:55:30.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2c1147fe-b7f3-44e0-bb81-f0308e8aabd2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92292024-11-09T02:55:31.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4107b267-2412-4b5d-9ac5-9787aa39b7b6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92302024-11-09T02:55:31.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4107b267-2412-4b5d-9ac5-9787aa39b7b6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92312024-11-09T02:55:31.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4107b267-2412-4b5d-9ac5-9787aa39b7b6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92322024-11-09T02:55:32.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22f972d9-33c6-4989-8ffe-09e627a1eb9d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92332024-11-09T02:55:32.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22f972d9-33c6-4989-8ffe-09e627a1eb9d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92342024-11-09T02:55:32.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22f972d9-33c6-4989-8ffe-09e627a1eb9d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
92352024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
92362024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
92372024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
92382024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92392024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
92402024-11-09T02:55:33.169ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
92412024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
92422024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.32\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
92432024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
92442024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
92452024-11-09T02:55:33.169ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:45:33.169564566 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92462024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92472024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
92482024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92492024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92502024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
92512024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92522024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
92532024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92542024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
92552024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92562024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
92572024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
92582024-11-09T02:55:33.169ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92592024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92602024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92612024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
92622024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92632024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
92642024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92652024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92662024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
92672024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
92682024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92692024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92702024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
92712024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92722024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92732024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
92742024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92752024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
92762024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
92772024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92782024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
92792024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
92802024-11-09T02:55:33.169ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92812024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92822024-11-09T02:55:33.169ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92832024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
92842024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92852024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
92862024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92872024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92882024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92892024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92902024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92912024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92922024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92932024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92942024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92952024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92962024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92972024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92982024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
92992024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
93002024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.37\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93012024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.7\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
93022024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
93032024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
93042024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.42\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
93052024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
93062024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
93072024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
93082024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93092024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
93102024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93112024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93122024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.591\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93132024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93142024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93152024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93162024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93172024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93182024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93192024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93202024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93212024-11-09T02:55:33.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 507529327 } })
93222024-11-09T02:55:33.170ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 507529947 } })
93232024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
93242024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
93252024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93262024-11-09T02:55:33.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93272024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93282024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93292024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93302024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
93312024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.682374ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
93322024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
93332024-11-09T02:55:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.787007ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
93342024-11-09T02:55:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93352024-11-09T02:55:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93362024-11-09T02:55:33.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93372024-11-09T02:55:33.174ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:45:33.169564566 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93382024-11-09T02:55:33.174ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.439232ms iteration = 10 status = {"expiration":"2024-11-09T02:45:33.169564566Z","pruned":[]}
93392024-11-09T02:55:33.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.587515ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93402024-11-09T02:55:33.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93412024-11-09T02:55:33.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93422024-11-09T02:55:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93432024-11-09T02:55:33.177ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93442024-11-09T02:55:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93452024-11-09T02:55:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93462024-11-09T02:55:33.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93472024-11-09T02:55:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93482024-11-09T02:55:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93492024-11-09T02:55:33.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93502024-11-09T02:55:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93512024-11-09T02:55:33.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93522024-11-09T02:55:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93532024-11-09T02:55:33.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93542024-11-09T02:55:33.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552024-11-09T02:55:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93562024-11-09T02:55:33.188ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93572024-11-09T02:55:33.188ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 525898597 } })
93582024-11-09T02:55:33.189ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
93592024-11-09T02:55:33.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93602024-11-09T02:55:33.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93612024-11-09T02:55:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93622024-11-09T02:55:33.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93632024-11-09T02:55:33.192ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93642024-11-09T02:55:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93652024-11-09T02:55:33.196ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 533286729 } })
93662024-11-09T02:55:33.196ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
93672024-11-09T02:55:33.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-11-09T02:55:33.197ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93692024-11-09T02:55:33.198ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 28.575021ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
93702024-11-09T02:55:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93712024-11-09T02:55:33.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93722024-11-09T02:55:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93732024-11-09T02:55:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93742024-11-09T02:55:33.200ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93752024-11-09T02:55:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93762024-11-09T02:55:33.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93772024-11-09T02:55:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93782024-11-09T02:55:33.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93792024-11-09T02:55:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93802024-11-09T02:55:33.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93812024-11-09T02:55:33.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93822024-11-09T02:55:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93832024-11-09T02:55:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93842024-11-09T02:55:33.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93852024-11-09T02:55:33.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93862024-11-09T02:55:33.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93872024-11-09T02:55:33.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93882024-11-09T02:55:33.213ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 549966414 } })
93892024-11-09T02:55:33.213ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
93902024-11-09T02:55:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93912024-11-09T02:55:33.215ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93922024-11-09T02:55:33.215ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.186225ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93932024-11-09T02:55:33.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93942024-11-09T02:55:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
93952024-11-09T02:55:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93962024-11-09T02:55:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93972024-11-09T02:55:33.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93982024-11-09T02:55:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93992024-11-09T02:55:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94002024-11-09T02:55:33.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94012024-11-09T02:55:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94022024-11-09T02:55:33.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94032024-11-09T02:55:33.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94042024-11-09T02:55:33.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
94052024-11-09T02:55:33.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94062024-11-09T02:55:33.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94072024-11-09T02:55:33.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94082024-11-09T02:55:33.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94092024-11-09T02:55:33.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94102024-11-09T02:55:33.239ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94112024-11-09T02:55:33.239ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
94122024-11-09T02:55:33.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94132024-11-09T02:55:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94142024-11-09T02:55:33.243ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.591941ms iteration = 21 status = {"physical_disks_added":0}
94152024-11-09T02:55:33.243ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
94162024-11-09T02:55:33.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.852887ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
94172024-11-09T02:55:33.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94182024-11-09T02:55:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
94192024-11-09T02:55:33.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
94202024-11-09T02:55:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
94212024-11-09T02:55:33.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94222024-11-09T02:55:33.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94232024-11-09T02:55:33.250ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
94242024-11-09T02:55:33.250ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
94252024-11-09T02:55:33.250ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.695777ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
94262024-11-09T02:55:33.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94272024-11-09T02:55:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94282024-11-09T02:55:33.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94292024-11-09T02:55:33.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94302024-11-09T02:55:33.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94312024-11-09T02:55:33.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.414343ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94322024-11-09T02:55:33.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94332024-11-09T02:55:33.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.825263ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94342024-11-09T02:55:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94352024-11-09T02:55:33.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94362024-11-09T02:55:33.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94372024-11-09T02:55:33.255ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94382024-11-09T02:55:33.255ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94392024-11-09T02:55:33.255ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94402024-11-09T02:55:33.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94412024-11-09T02:55:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94422024-11-09T02:55:33.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94432024-11-09T02:55:33.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94442024-11-09T02:55:33.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94452024-11-09T02:55:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94462024-11-09T02:55:33.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94472024-11-09T02:55:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94482024-11-09T02:55:33.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94492024-11-09T02:55:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94502024-11-09T02:55:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94512024-11-09T02:55:33.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94522024-11-09T02:55:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94532024-11-09T02:55:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 94.189316ms iteration = 5 status = {"nsuccess":5}
94542024-11-09T02:55:33.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94552024-11-09T02:55:33.265ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94562024-11-09T02:55:33.265ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
94572024-11-09T02:55:33.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94582024-11-09T02:55:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94592024-11-09T02:55:33.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94602024-11-09T02:55:33.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94612024-11-09T02:55:33.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94622024-11-09T02:55:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94632024-11-09T02:55:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94642024-11-09T02:55:33.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94652024-11-09T02:55:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94662024-11-09T02:55:33.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94672024-11-09T02:55:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94682024-11-09T02:55:33.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94692024-11-09T02:55:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94702024-11-09T02:55:33.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94712024-11-09T02:55:33.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94722024-11-09T02:55:33.280ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94732024-11-09T02:55:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94742024-11-09T02:55:33.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94752024-11-09T02:55:33.282ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
94762024-11-09T02:55:33.283ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94772024-11-09T02:55:33.283ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
94782024-11-09T02:55:33.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 113.393634ms iteration = 10 status = {"generation":2}
94792024-11-09T02:55:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94802024-11-09T02:55:33.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94812024-11-09T02:55:33.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94822024-11-09T02:55:33.286ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94832024-11-09T02:55:33.286ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94842024-11-09T02:55:33.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94852024-11-09T02:55:33.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94862024-11-09T02:55:33.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94872024-11-09T02:55:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
94882024-11-09T02:55:33.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94892024-11-09T02:55:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94902024-11-09T02:55:33.296ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 126.28951ms iteration = 19 status = 0
94912024-11-09T02:55:33.296ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94922024-11-09T02:55:33.301ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
94932024-11-09T02:55:33.301ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
94942024-11-09T02:55:33.301ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 131.400056ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
94952024-11-09T02:55:33.303ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94962024-11-09T02:55:33.303ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94972024-11-09T02:55:33.303ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94982024-11-09T02:55:33.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94992024-11-09T02:55:33.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95002024-11-09T02:55:33.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95012024-11-09T02:55:33.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95022024-11-09T02:55:33.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95032024-11-09T02:55:33.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95042024-11-09T02:55:33.312ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
95052024-11-09T02:55:33.312ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
95062024-11-09T02:55:33.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95072024-11-09T02:55:33.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95082024-11-09T02:55:33.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95092024-11-09T02:55:33.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95102024-11-09T02:55:33.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95112024-11-09T02:55:33.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95122024-11-09T02:55:33.322ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
95132024-11-09T02:55:33.322ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
95142024-11-09T02:55:33.322ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
95152024-11-09T02:55:33.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 152.765377ms iteration = 10 status = {"generation":1}
95162024-11-09T02:55:33.329ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
95172024-11-09T02:55:33.329ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.128179ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
95182024-11-09T02:55:33.336ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95192024-11-09T02:55:33.336ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95202024-11-09T02:55:33.336ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.003311ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
95212024-11-09T02:55:33.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
95222024-11-09T02:55:33.354ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95232024-11-09T02:55:33.355ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "006ab3c5-7cf1-4887-bf43-43ae2e8f1582", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:32 GMT"} })
95242024-11-09T02:55:33.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95252024-11-09T02:55:33.357ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95262024-11-09T02:55:33.387ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
95272024-11-09T02:55:33.387ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 218.155207ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
95282024-11-09T02:55:33.390ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
95292024-11-09T02:55:33.390ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95302024-11-09T02:55:33.390ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5216848f-4942-4ad9-9cfd-17393a75c929", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95312024-11-09T02:55:33.390ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95322024-11-09T02:55:33.392ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
95332024-11-09T02:55:33.397ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95342024-11-09T02:55:33.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95352024-11-09T02:55:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95362024-11-09T02:55:33.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
95372024-11-09T02:55:33.471ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95382024-11-09T02:55:33.471ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d271b7d-df82-4c07-a08e-b4f336cc4b97", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95392024-11-09T02:55:33.471ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95402024-11-09T02:55:33.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95412024-11-09T02:55:33.487ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95422024-11-09T02:55:33.487ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "75709f42-0535-4b9c-90bc-e81e34d64e7a", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95432024-11-09T02:55:33.487ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95442024-11-09T02:55:33.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "aa870bdf-3bbe-43b0-8484-b7cdbb2dbaf0", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95452024-11-09T02:55:33.488ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95462024-11-09T02:55:33.490ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95472024-11-09T02:55:33.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.016344ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95482024-11-09T02:55:33.560ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95492024-11-09T02:55:33.560ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95502024-11-09T02:55:33.560ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ec13a53-57b7-4e20-9755-623af6489c43", "content-length": "372", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95512024-11-09T02:55:33.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95522024-11-09T02:55:33.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95532024-11-09T02:55:33.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95542024-11-09T02:55:33.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95552024-11-09T02:55:33.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95562024-11-09T02:55:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95572024-11-09T02:55:33.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95582024-11-09T02:55:33.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95592024-11-09T02:55:33.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95602024-11-09T02:55:33.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95612024-11-09T02:55:33.585ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
95622024-11-09T02:55:33.604ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
95632024-11-09T02:55:33.604ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95642024-11-09T02:55:33.612ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95652024-11-09T02:55:33.613ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf11afb9-efdb-43ce-a2f8-ba375aa275d1", "content-length": "1", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95662024-11-09T02:55:33.615ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 445.585868ms iteration = 19 status = {}
95672024-11-09T02:55:33.615ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95682024-11-09T02:55:33.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95692024-11-09T02:55:33.618ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.779354ms iteration = 19 status = null
95702024-11-09T02:55:33.678ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95712024-11-09T02:55:33.679ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fbff6198-b02e-4373-8caf-94e38cdf1f44", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95722024-11-09T02:55:33.679ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95732024-11-09T02:55:33.680ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b7613433-a093-46bf-aae3-c1612569a7b6", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95742024-11-09T02:55:33.680ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95752024-11-09T02:55:33.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3e11f250-334f-4c66-b271-badbe1333e86", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95762024-11-09T02:55:33.682ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95772024-11-09T02:55:33.684ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
95782024-11-09T02:55:33.684ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 514.686607ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95792024-11-09T02:55:33.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f774bdae-c9a1-440e-937e-a2c9b50d19ae roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
95802024-11-09T02:55:33.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f774bdae-c9a1-440e-937e-a2c9b50d19ae resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
95812024-11-09T02:55:33.691ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "48344523-1e3c-4a06-bf85-fe429b262b30", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95822024-11-09T02:55:33.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95832024-11-09T02:55:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95842024-11-09T02:55:33.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f774bdae-c9a1-440e-937e-a2c9b50d19ae response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
95852024-11-09T02:55:33.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95862024-11-09T02:55:33.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95872024-11-09T02:55:33.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95882024-11-09T02:55:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95892024-11-09T02:55:33.703ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95902024-11-09T02:55:33.704ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b73485-29e4-4133-b603-b70eed329ad6", "content-length": "691", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95912024-11-09T02:55:33.704ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
95922024-11-09T02:55:33.704ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95932024-11-09T02:55:33.704ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95942024-11-09T02:55:33.706ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 536.464716ms iteration = 19 status = {}
95952024-11-09T02:55:33.707ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95962024-11-09T02:55:33.707ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95972024-11-09T02:55:33.707ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7dad9941-a2a0-47f0-b88a-c2f4b7d9f471", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
95982024-11-09T02:55:33.709ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 540.112752ms iteration = 19 status = {}
95992024-11-09T02:55:33.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96002024-11-09T02:55:33.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96012024-11-09T02:55:33.740ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
96022024-11-09T02:55:33.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96032024-11-09T02:55:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96042024-11-09T02:55:33.748ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
96052024-11-09T02:55:33.749ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a47158ac-efa5-456a-8b6a-2a39814f4052", "content-length": "134", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
96062024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
96072024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
96082024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
96092024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96102024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96112024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96122024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96132024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96142024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96152024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96162024-11-09T02:55:33.749ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
96172024-11-09T02:55:33.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96182024-11-09T02:55:33.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96192024-11-09T02:55:33.756ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96202024-11-09T02:55:33.756ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c7ce02a-724c-49c1-a05c-6bb22a78f5bf", "content-length": "2", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
96212024-11-09T02:55:33.756ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96222024-11-09T02:55:33.756ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b542b5b6-5aea-4af3-9c7a-eab4e8a73d0b", "content-length": "52", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
96232024-11-09T02:55:33.756ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
96242024-11-09T02:55:33.756ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96252024-11-09T02:55:33.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "798f4aec-8cf7-4fc1-9588-1d42913896e3", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
96262024-11-09T02:55:33.929ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
96272024-11-09T02:55:33.929ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96282024-11-09T02:55:33.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d560043b-cf92-473f-840b-0d97db741a11", "content-length": "682", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
96292024-11-09T02:55:33.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96302024-11-09T02:55:33.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96312024-11-09T02:55:33.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96322024-11-09T02:55:33.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96332024-11-09T02:55:33.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96342024-11-09T02:55:33.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96352024-11-09T02:55:33.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96362024-11-09T02:55:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96372024-11-09T02:55:33.945ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 775.167149ms iteration = 19 status = {}
96382024-11-09T02:55:34.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d6538f47-516a-4b77-ad1d-693e2d93137c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
96392024-11-09T02:55:34.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d6538f47-516a-4b77-ad1d-693e2d93137c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
96402024-11-09T02:55:34.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d6538f47-516a-4b77-ad1d-693e2d93137c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
96412024-11-09T02:55:34.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6ce7f53d-8e9e-436e-b569-04dc93e02eae roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96422024-11-09T02:55:34.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6ce7f53d-8e9e-436e-b569-04dc93e02eae resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96432024-11-09T02:55:34.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6ce7f53d-8e9e-436e-b569-04dc93e02eae response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96442024-11-09T02:55:35.144ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:64686
96452024-11-09T02:55:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64686 req_id = 813b1c72-7857-45a2-9f51-b23ecbd4db4f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
96462024-11-09T02:55:35.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64686 req_id = 813b1c72-7857-45a2-9f51-b23ecbd4db4f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
96472024-11-09T02:55:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64686 req_id = 813b1c72-7857-45a2-9f51-b23ecbd4db4f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
96482024-11-09T02:55:35.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64686 req_id = 02f44121-37ba-45db-8014-79c32559df56 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
96492024-11-09T02:55:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64686 req_id = 02f44121-37ba-45db-8014-79c32559df56 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
96502024-11-09T02:55:35.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64686 req_id = 02f44121-37ba-45db-8014-79c32559df56 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
96512024-11-09T02:55:35.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb0f03aa-f5ac-447a-aa4b-94a2988058bc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96522024-11-09T02:55:35.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb0f03aa-f5ac-447a-aa4b-94a2988058bc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96532024-11-09T02:55:35.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fb0f03aa-f5ac-447a-aa4b-94a2988058bc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96542024-11-09T02:55:36.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8f7e3b1d-4acb-4726-abc8-39fb57312bfd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96552024-11-09T02:55:36.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8f7e3b1d-4acb-4726-abc8-39fb57312bfd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96562024-11-09T02:55:36.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8f7e3b1d-4acb-4726-abc8-39fb57312bfd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96572024-11-09T02:55:37.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9072409-148f-4b0d-9891-73f1bb90e8d2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96582024-11-09T02:55:37.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9072409-148f-4b0d-9891-73f1bb90e8d2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96592024-11-09T02:55:37.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9072409-148f-4b0d-9891-73f1bb90e8d2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96602024-11-09T02:55:38.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1cc8aa7b-53c7-46fe-a98e-d85226dad432 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96612024-11-09T02:55:38.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1cc8aa7b-53c7-46fe-a98e-d85226dad432 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96622024-11-09T02:55:38.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1cc8aa7b-53c7-46fe-a98e-d85226dad432 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96632024-11-09T02:55:39.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 35b40c7d-c1a6-438c-8b05-0fdf9381e4c3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96642024-11-09T02:55:39.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 35b40c7d-c1a6-438c-8b05-0fdf9381e4c3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96652024-11-09T02:55:39.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 35b40c7d-c1a6-438c-8b05-0fdf9381e4c3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96662024-11-09T02:55:40.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6df518d7-36a9-4a67-934e-200c59c235b0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96672024-11-09T02:55:40.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6df518d7-36a9-4a67-934e-200c59c235b0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96682024-11-09T02:55:40.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6df518d7-36a9-4a67-934e-200c59c235b0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96692024-11-09T02:55:41.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7551e892-bb78-4f34-bf76-f1f19a6e7d96 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96702024-11-09T02:55:41.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7551e892-bb78-4f34-bf76-f1f19a6e7d96 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96712024-11-09T02:55:41.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7551e892-bb78-4f34-bf76-f1f19a6e7d96 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96722024-11-09T02:55:42.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef421cdc-ebc8-4ecc-8531-bdc34467b34a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96732024-11-09T02:55:42.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef421cdc-ebc8-4ecc-8531-bdc34467b34a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96742024-11-09T02:55:42.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef421cdc-ebc8-4ecc-8531-bdc34467b34a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96752024-11-09T02:55:43.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
96762024-11-09T02:55:43.169ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
96772024-11-09T02:55:43.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96782024-11-09T02:55:43.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96792024-11-09T02:55:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96802024-11-09T02:55:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96812024-11-09T02:55:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96822024-11-09T02:55:43.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96832024-11-09T02:55:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96842024-11-09T02:55:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96852024-11-09T02:55:43.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96862024-11-09T02:55:43.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96872024-11-09T02:55:43.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96882024-11-09T02:55:43.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
96892024-11-09T02:55:43.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96902024-11-09T02:55:43.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96912024-11-09T02:55:43.196ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
96922024-11-09T02:55:43.196ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.145061ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
96932024-11-09T02:55:43.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96942024-11-09T02:55:43.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96952024-11-09T02:55:43.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.140942ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96962024-11-09T02:55:43.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1ed8ed7-07bc-41c4-a4c0-1ed6b0c726ab roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96972024-11-09T02:55:43.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1ed8ed7-07bc-41c4-a4c0-1ed6b0c726ab resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96982024-11-09T02:55:43.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1ed8ed7-07bc-41c4-a4c0-1ed6b0c726ab response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
96992024-11-09T02:55:44.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b327a7e-5cc0-4804-a4cb-83609b212ff7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97002024-11-09T02:55:44.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b327a7e-5cc0-4804-a4cb-83609b212ff7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97012024-11-09T02:55:44.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b327a7e-5cc0-4804-a4cb-83609b212ff7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97022024-11-09T02:55:45.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 893 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 48689f71-c0b9-4670-b3fc-32a45cbbf7c5 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
97032024-11-09T02:55:45.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d01e96b7-044e-40dc-a240-9b4000fa5eda roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97042024-11-09T02:55:45.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d01e96b7-044e-40dc-a240-9b4000fa5eda resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97052024-11-09T02:55:45.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d01e96b7-044e-40dc-a240-9b4000fa5eda response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97062024-11-09T02:55:46.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41ffe19c-995e-411b-ba43-7a5b363fc8ee roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97072024-11-09T02:55:46.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41ffe19c-995e-411b-ba43-7a5b363fc8ee resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97082024-11-09T02:55:46.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41ffe19c-995e-411b-ba43-7a5b363fc8ee response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97092024-11-09T02:55:48.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3d2fb83-d270-4032-9b87-97530cb1cb95 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97102024-11-09T02:55:48.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3d2fb83-d270-4032-9b87-97530cb1cb95 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97112024-11-09T02:55:48.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3d2fb83-d270-4032-9b87-97530cb1cb95 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97122024-11-09T02:55:49.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a0589217-b868-43bc-96ee-4f9c01fae8a3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97132024-11-09T02:55:49.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a0589217-b868-43bc-96ee-4f9c01fae8a3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97142024-11-09T02:55:49.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a0589217-b868-43bc-96ee-4f9c01fae8a3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97152024-11-09T02:55:50.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fc3bb22c-d4a3-42b6-8ccd-4a289ec09dfc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97162024-11-09T02:55:50.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fc3bb22c-d4a3-42b6-8ccd-4a289ec09dfc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97172024-11-09T02:55:50.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fc3bb22c-d4a3-42b6-8ccd-4a289ec09dfc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97182024-11-09T02:55:51.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e61f209e-70e7-44c3-878f-47621d557f1c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97192024-11-09T02:55:51.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e61f209e-70e7-44c3-878f-47621d557f1c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97202024-11-09T02:55:51.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e61f209e-70e7-44c3-878f-47621d557f1c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97212024-11-09T02:55:52.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b402e9f1-31d4-4775-a729-c91ac05b06cf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97222024-11-09T02:55:52.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b402e9f1-31d4-4775-a729-c91ac05b06cf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97232024-11-09T02:55:52.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b402e9f1-31d4-4775-a729-c91ac05b06cf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97242024-11-09T02:55:53.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c259f4c-81d6-4422-819d-5b78f58d77fc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97252024-11-09T02:55:53.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c259f4c-81d6-4422-819d-5b78f58d77fc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97262024-11-09T02:55:53.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c259f4c-81d6-4422-819d-5b78f58d77fc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97272024-11-09T02:55:53.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
97282024-11-09T02:55:53.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
97292024-11-09T02:55:53.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97302024-11-09T02:55:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97312024-11-09T02:55:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97322024-11-09T02:55:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97332024-11-09T02:55:53.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97342024-11-09T02:55:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97352024-11-09T02:55:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97362024-11-09T02:55:53.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.338299ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97372024-11-09T02:55:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97382024-11-09T02:55:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97392024-11-09T02:55:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97402024-11-09T02:55:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97412024-11-09T02:55:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97422024-11-09T02:55:53.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97432024-11-09T02:55:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
97442024-11-09T02:55:53.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97452024-11-09T02:55:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97462024-11-09T02:55:53.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
97472024-11-09T02:55:53.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.754879ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
97482024-11-09T02:55:54.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 32669e3a-9d7f-4022-bf1d-58b28023f821 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97492024-11-09T02:55:54.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 32669e3a-9d7f-4022-bf1d-58b28023f821 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97502024-11-09T02:55:54.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 32669e3a-9d7f-4022-bf1d-58b28023f821 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97512024-11-09T02:55:55.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f148c8cf-1a7b-4c3b-a606-37511bbd915d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97522024-11-09T02:55:55.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f148c8cf-1a7b-4c3b-a606-37511bbd915d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97532024-11-09T02:55:55.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f148c8cf-1a7b-4c3b-a606-37511bbd915d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97542024-11-09T02:55:56.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d441a1ed-45be-4734-9cbd-d1ef8c3e17fa roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97552024-11-09T02:55:56.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d441a1ed-45be-4734-9cbd-d1ef8c3e17fa resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97562024-11-09T02:55:56.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d441a1ed-45be-4734-9cbd-d1ef8c3e17fa response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97572024-11-09T02:55:57.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e24de0a1-e9ec-4488-87c0-ce81b07caae1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97582024-11-09T02:55:57.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e24de0a1-e9ec-4488-87c0-ce81b07caae1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97592024-11-09T02:55:57.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e24de0a1-e9ec-4488-87c0-ce81b07caae1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97602024-11-09T02:55:58.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4390c0a-502c-4246-a24f-56ddd2bedc5e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97612024-11-09T02:55:58.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4390c0a-502c-4246-a24f-56ddd2bedc5e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97622024-11-09T02:55:58.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4390c0a-502c-4246-a24f-56ddd2bedc5e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97632024-11-09T02:55:59.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5c625bcd-1e2c-4f8b-aa81-6c5e75083942 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97642024-11-09T02:55:59.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5c625bcd-1e2c-4f8b-aa81-6c5e75083942 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97652024-11-09T02:55:59.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5c625bcd-1e2c-4f8b-aa81-6c5e75083942 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97662024-11-09T02:56:00.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 823 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 791e0a88-0ac3-4277-80f0-fd135b9c4067 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
97672024-11-09T02:56:00.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1787973-d6db-4d3e-a4bb-5df07c8f872c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97682024-11-09T02:56:00.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1787973-d6db-4d3e-a4bb-5df07c8f872c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97692024-11-09T02:56:00.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1787973-d6db-4d3e-a4bb-5df07c8f872c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97702024-11-09T02:56:01.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea4f6efd-71c6-4676-9964-bc3f727721e3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97712024-11-09T02:56:01.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea4f6efd-71c6-4676-9964-bc3f727721e3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97722024-11-09T02:56:01.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ea4f6efd-71c6-4676-9964-bc3f727721e3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97732024-11-09T02:56:02.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d131631-6365-459b-801f-b60c88d7d4ce roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97742024-11-09T02:56:02.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d131631-6365-459b-801f-b60c88d7d4ce resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97752024-11-09T02:56:02.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d131631-6365-459b-801f-b60c88d7d4ce response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
97762024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
97772024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97782024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
97792024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97802024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97812024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
97822024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97832024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
97842024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
97852024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
97862024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97872024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97882024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
97892024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
97902024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
97912024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97922024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97932024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97942024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
97952024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
97962024-11-09T02:56:03.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97972024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97982024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97992024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
98002024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98012024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
98022024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98032024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
98042024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.08\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
98052024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
98062024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
98072024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.03\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98082024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
98092024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.42\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
98102024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98112024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98122024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98132024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98142024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98152024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98162024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
98172024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98182024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98192024-11-09T02:56:03.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98202024-11-09T02:56:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98212024-11-09T02:56:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98222024-11-09T02:56:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98232024-11-09T02:56:03.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98242024-11-09T02:56:03.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98252024-11-09T02:56:03.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98262024-11-09T02:56:03.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.359511ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
98272024-11-09T02:56:03.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98282024-11-09T02:56:03.175ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 512481539 } })
98292024-11-09T02:56:03.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
98302024-11-09T02:56:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98312024-11-09T02:56:03.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98322024-11-09T02:56:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98332024-11-09T02:56:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98342024-11-09T02:56:03.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98352024-11-09T02:56:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98362024-11-09T02:56:03.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98372024-11-09T02:56:03.180ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 517222327 } })
98382024-11-09T02:56:03.180ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98392024-11-09T02:56:03.180ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
98402024-11-09T02:56:03.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-11-09T02:56:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98422024-11-09T02:56:03.183ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98432024-11-09T02:56:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98442024-11-09T02:56:03.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98452024-11-09T02:56:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98462024-11-09T02:56:03.184ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98472024-11-09T02:56:03.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98482024-11-09T02:56:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98492024-11-09T02:56:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98502024-11-09T02:56:03.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98512024-11-09T02:56:03.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98522024-11-09T02:56:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98532024-11-09T02:56:03.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 524162941 } })
98542024-11-09T02:56:03.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
98552024-11-09T02:56:03.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98562024-11-09T02:56:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98572024-11-09T02:56:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98582024-11-09T02:56:03.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98592024-11-09T02:56:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98602024-11-09T02:56:03.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98612024-11-09T02:56:03.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98622024-11-09T02:56:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
98632024-11-09T02:56:03.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98642024-11-09T02:56:03.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98652024-11-09T02:56:03.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98662024-11-09T02:56:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98672024-11-09T02:56:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98682024-11-09T02:56:03.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98692024-11-09T02:56:03.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98702024-11-09T02:56:03.199ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98712024-11-09T02:56:03.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98722024-11-09T02:56:03.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98732024-11-09T02:56:03.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98742024-11-09T02:56:03.227ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
98752024-11-09T02:56:03.227ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.56347ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
98762024-11-09T02:56:03.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98772024-11-09T02:56:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98782024-11-09T02:56:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.774778ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98792024-11-09T02:56:03.235ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98802024-11-09T02:56:03.235ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98812024-11-09T02:56:03.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98822024-11-09T02:56:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98832024-11-09T02:56:03.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98842024-11-09T02:56:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98852024-11-09T02:56:03.238ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98862024-11-09T02:56:03.238ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98872024-11-09T02:56:03.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98882024-11-09T02:56:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98892024-11-09T02:56:03.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.259062ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98902024-11-09T02:56:03.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98912024-11-09T02:56:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98922024-11-09T02:56:03.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98932024-11-09T02:56:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98942024-11-09T02:56:03.248ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98952024-11-09T02:56:03.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.572443ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98962024-11-09T02:56:03.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98972024-11-09T02:56:03.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98982024-11-09T02:56:03.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98992024-11-09T02:56:03.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99002024-11-09T02:56:03.250ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99012024-11-09T02:56:03.250ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99022024-11-09T02:56:03.251ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a0dbaf6-7798-4b5c-b3a4-0d261a80b104", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99032024-11-09T02:56:03.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99042024-11-09T02:56:03.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99052024-11-09T02:56:03.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99062024-11-09T02:56:03.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99072024-11-09T02:56:03.252ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99082024-11-09T02:56:03.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99092024-11-09T02:56:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
99102024-11-09T02:56:03.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99112024-11-09T02:56:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99122024-11-09T02:56:03.254ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
99132024-11-09T02:56:03.254ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99142024-11-09T02:56:03.254ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e641013-c853-4a90-9492-1fe3cac19673", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99152024-11-09T02:56:03.254ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99162024-11-09T02:56:03.255ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99172024-11-09T02:56:03.255ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99182024-11-09T02:56:03.255ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a1d22d3-c0d4-48d4-b191-43170179d88f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99192024-11-09T02:56:03.255ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99202024-11-09T02:56:03.256ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.936936ms iteration = 20 status = 0
99212024-11-09T02:56:03.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99222024-11-09T02:56:03.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99232024-11-09T02:56:03.257ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
99242024-11-09T02:56:03.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99252024-11-09T02:56:03.257ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99262024-11-09T02:56:03.258ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.850266ms iteration = 22 status = {"physical_disks_added":0}
99272024-11-09T02:56:03.277ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99282024-11-09T02:56:03.277ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99292024-11-09T02:56:03.277ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.469281ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99302024-11-09T02:56:03.362ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99312024-11-09T02:56:03.362ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "96433f4e-eec0-4728-917b-743b675edb35", "content-length": "1", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
99322024-11-09T02:56:03.363ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99332024-11-09T02:56:03.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99342024-11-09T02:56:03.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 568fc6b8-c02c-495b-a366-c5463e5228d7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
99352024-11-09T02:56:03.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 568fc6b8-c02c-495b-a366-c5463e5228d7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
99362024-11-09T02:56:03.387ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.131457ms iteration = 20 status = {}
99372024-11-09T02:56:03.402ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99382024-11-09T02:56:03.402ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99392024-11-09T02:56:03.402ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2602ba30-6ec4-47a7-a86b-6180a17b9a0c", "content-length": "372", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99402024-11-09T02:56:03.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99412024-11-09T02:56:03.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99422024-11-09T02:56:03.404ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.22441ms iteration = 20 status = null
99432024-11-09T02:56:03.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 568fc6b8-c02c-495b-a366-c5463e5228d7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
99442024-11-09T02:56:03.418ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99452024-11-09T02:56:03.418ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99462024-11-09T02:56:03.419ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "55851502-ff63-4c51-9c0e-b602e80dfd0b", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99472024-11-09T02:56:03.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99482024-11-09T02:56:03.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99492024-11-09T02:56:03.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99502024-11-09T02:56:03.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99512024-11-09T02:56:03.452ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99522024-11-09T02:56:03.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99532024-11-09T02:56:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99542024-11-09T02:56:03.460ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99552024-11-09T02:56:03.460ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99562024-11-09T02:56:03.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99572024-11-09T02:56:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99582024-11-09T02:56:03.518ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
99592024-11-09T02:56:03.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99602024-11-09T02:56:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99612024-11-09T02:56:03.527ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99622024-11-09T02:56:03.527ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "024267ae-cb50-4f78-9952-ac76017b60cc", "content-length": "134", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
99632024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99642024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
99652024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99662024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99672024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99682024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99692024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99702024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99712024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99722024-11-09T02:56:03.527ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99732024-11-09T02:56:03.528ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
99742024-11-09T02:56:03.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99752024-11-09T02:56:03.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99762024-11-09T02:56:03.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99772024-11-09T02:56:03.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "529ef73d-51ae-4dfe-8654-14320440306b", "content-length": "2", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
99782024-11-09T02:56:03.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99792024-11-09T02:56:03.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "532dde54-091f-4290-b9de-ebce4f45bcff", "content-length": "52", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
99802024-11-09T02:56:03.530ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
99812024-11-09T02:56:03.530ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99822024-11-09T02:56:03.548ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d1be8325-0995-43a7-afe0-343a82efb057", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99832024-11-09T02:56:03.549ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 379.523933ms iteration = 20 status = {}
99842024-11-09T02:56:03.550ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "73454678-8b51-4950-bdf6-2015c714f64f", "content-length": "691", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99852024-11-09T02:56:03.550ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99862024-11-09T02:56:03.550ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99872024-11-09T02:56:03.550ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99882024-11-09T02:56:03.551ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 381.193317ms iteration = 20 status = {}
99892024-11-09T02:56:03.744ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "539333c1-e8eb-4aa9-b3ff-8214ae440a1a", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99902024-11-09T02:56:03.744ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
99912024-11-09T02:56:03.744ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99922024-11-09T02:56:03.745ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ecbde03-ec30-4eae-834a-f0bbcc3d054e", "content-length": "682", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
99932024-11-09T02:56:03.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99942024-11-09T02:56:03.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99952024-11-09T02:56:03.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99962024-11-09T02:56:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99972024-11-09T02:56:03.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99982024-11-09T02:56:03.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99992024-11-09T02:56:03.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100002024-11-09T02:56:03.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100012024-11-09T02:56:03.761ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 591.135306ms iteration = 20 status = {}
100022024-11-09T02:56:04.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 01b441d7-e17c-4713-8a9d-6c3d6cfadd9b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
100032024-11-09T02:56:04.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 01b441d7-e17c-4713-8a9d-6c3d6cfadd9b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
100042024-11-09T02:56:04.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 01b441d7-e17c-4713-8a9d-6c3d6cfadd9b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
100052024-11-09T02:56:04.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5bbb0620-6648-4fe3-8cfe-2d4d734ed606 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100062024-11-09T02:56:04.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5bbb0620-6648-4fe3-8cfe-2d4d734ed606 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100072024-11-09T02:56:04.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5bbb0620-6648-4fe3-8cfe-2d4d734ed606 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100082024-11-09T02:56:05.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 133e0014-3af7-4e96-a6d1-6df1882ff2e5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100092024-11-09T02:56:05.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 133e0014-3af7-4e96-a6d1-6df1882ff2e5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100102024-11-09T02:56:05.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 133e0014-3af7-4e96-a6d1-6df1882ff2e5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100112024-11-09T02:56:06.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d708c3d-daa4-4b1e-bd84-8c6a1ed45fea roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100122024-11-09T02:56:06.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d708c3d-daa4-4b1e-bd84-8c6a1ed45fea resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100132024-11-09T02:56:06.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d708c3d-daa4-4b1e-bd84-8c6a1ed45fea response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100142024-11-09T02:56:07.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06963105-e3f7-4cea-9f9d-d3279ba5840e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100152024-11-09T02:56:07.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06963105-e3f7-4cea-9f9d-d3279ba5840e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100162024-11-09T02:56:07.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 06963105-e3f7-4cea-9f9d-d3279ba5840e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100172024-11-09T02:56:08.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ba6f031-902e-4393-860e-e6b07973189c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100182024-11-09T02:56:08.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ba6f031-902e-4393-860e-e6b07973189c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100192024-11-09T02:56:08.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ba6f031-902e-4393-860e-e6b07973189c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100202024-11-09T02:56:09.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2b6ef6c7-4557-4939-be69-4594d7100fc9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100212024-11-09T02:56:09.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2b6ef6c7-4557-4939-be69-4594d7100fc9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100222024-11-09T02:56:09.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2b6ef6c7-4557-4939-be69-4594d7100fc9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100232024-11-09T02:56:10.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d23a13e1-f8e3-4d11-8acd-388d5c65124c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100242024-11-09T02:56:10.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d23a13e1-f8e3-4d11-8acd-388d5c65124c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100252024-11-09T02:56:10.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d23a13e1-f8e3-4d11-8acd-388d5c65124c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100262024-11-09T02:56:11.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6fe1ca8-b273-4ac0-afea-4bc38e05b8d2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100272024-11-09T02:56:11.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6fe1ca8-b273-4ac0-afea-4bc38e05b8d2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100282024-11-09T02:56:11.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b6fe1ca8-b273-4ac0-afea-4bc38e05b8d2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100292024-11-09T02:56:12.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a00993ed-165f-4295-befe-b14d6a38938c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100302024-11-09T02:56:12.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a00993ed-165f-4295-befe-b14d6a38938c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100312024-11-09T02:56:12.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a00993ed-165f-4295-befe-b14d6a38938c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100322024-11-09T02:56:13.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
100332024-11-09T02:56:13.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
100342024-11-09T02:56:13.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100352024-11-09T02:56:13.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100362024-11-09T02:56:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100372024-11-09T02:56:13.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100382024-11-09T02:56:13.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100392024-11-09T02:56:13.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100402024-11-09T02:56:13.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100412024-11-09T02:56:13.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100422024-11-09T02:56:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100432024-11-09T02:56:13.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100442024-11-09T02:56:13.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100452024-11-09T02:56:13.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
100462024-11-09T02:56:13.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100472024-11-09T02:56:13.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100482024-11-09T02:56:13.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
100492024-11-09T02:56:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.766889ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
100502024-11-09T02:56:13.199ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100512024-11-09T02:56:13.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100522024-11-09T02:56:13.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.534569ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100532024-11-09T02:56:13.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4ab20c17-b9f6-49cd-9f8b-c72aac71d456 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100542024-11-09T02:56:13.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4ab20c17-b9f6-49cd-9f8b-c72aac71d456 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100552024-11-09T02:56:13.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4ab20c17-b9f6-49cd-9f8b-c72aac71d456 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100562024-11-09T02:56:14.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9c8dc15e-8f7e-40f2-8117-db252c1df95e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100572024-11-09T02:56:14.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9c8dc15e-8f7e-40f2-8117-db252c1df95e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100582024-11-09T02:56:14.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9c8dc15e-8f7e-40f2-8117-db252c1df95e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100592024-11-09T02:56:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 961 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = e511bfb3-fee2-4936-936b-51a3b922e046 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
100602024-11-09T02:56:15.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f0a2bb40-563d-4007-a994-6c27217696f3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100612024-11-09T02:56:15.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f0a2bb40-563d-4007-a994-6c27217696f3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100622024-11-09T02:56:15.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f0a2bb40-563d-4007-a994-6c27217696f3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100632024-11-09T02:56:16.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 99023d62-396f-42e5-a28f-99054846ad22 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100642024-11-09T02:56:16.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 99023d62-396f-42e5-a28f-99054846ad22 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100652024-11-09T02:56:16.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 99023d62-396f-42e5-a28f-99054846ad22 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100662024-11-09T02:56:17.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c680c61f-bee8-435b-a0ba-10a0ff8fb710 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100672024-11-09T02:56:17.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c680c61f-bee8-435b-a0ba-10a0ff8fb710 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100682024-11-09T02:56:17.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c680c61f-bee8-435b-a0ba-10a0ff8fb710 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100692024-11-09T02:56:18.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 939fef73-e234-4cba-9c38-8bfd1a9930e3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100702024-11-09T02:56:18.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 939fef73-e234-4cba-9c38-8bfd1a9930e3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100712024-11-09T02:56:18.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 939fef73-e234-4cba-9c38-8bfd1a9930e3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100722024-11-09T02:56:19.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b9b6693f-29e7-4a70-bef8-eadc2cf7a6f6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100732024-11-09T02:56:19.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b9b6693f-29e7-4a70-bef8-eadc2cf7a6f6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100742024-11-09T02:56:19.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b9b6693f-29e7-4a70-bef8-eadc2cf7a6f6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100752024-11-09T02:56:20.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 87cda48f-6db8-42d1-9bbc-bb0bb37961eb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100762024-11-09T02:56:20.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 87cda48f-6db8-42d1-9bbc-bb0bb37961eb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100772024-11-09T02:56:20.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 87cda48f-6db8-42d1-9bbc-bb0bb37961eb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100782024-11-09T02:56:21.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c56e8542-39fe-42c8-bee5-51d28f506c77 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100792024-11-09T02:56:21.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c56e8542-39fe-42c8-bee5-51d28f506c77 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100802024-11-09T02:56:21.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c56e8542-39fe-42c8-bee5-51d28f506c77 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100812024-11-09T02:56:22.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 11c85ef8-36d6-4bef-ab95-cf1879392777 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100822024-11-09T02:56:22.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 11c85ef8-36d6-4bef-ab95-cf1879392777 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100832024-11-09T02:56:22.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 11c85ef8-36d6-4bef-ab95-cf1879392777 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
100842024-11-09T02:56:23.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
100852024-11-09T02:56:23.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
100862024-11-09T02:56:23.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100872024-11-09T02:56:23.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100882024-11-09T02:56:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100892024-11-09T02:56:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100902024-11-09T02:56:23.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100912024-11-09T02:56:23.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100922024-11-09T02:56:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100932024-11-09T02:56:23.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.871062ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100942024-11-09T02:56:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100952024-11-09T02:56:23.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100962024-11-09T02:56:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100972024-11-09T02:56:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100982024-11-09T02:56:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100992024-11-09T02:56:23.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101002024-11-09T02:56:23.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
101012024-11-09T02:56:23.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101022024-11-09T02:56:23.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101032024-11-09T02:56:23.221ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
101042024-11-09T02:56:23.221ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.094426ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
101052024-11-09T02:56:23.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3244ed7d-f612-4923-8b6e-2499107199e6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101062024-11-09T02:56:23.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3244ed7d-f612-4923-8b6e-2499107199e6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101072024-11-09T02:56:23.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3244ed7d-f612-4923-8b6e-2499107199e6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101082024-11-09T02:56:24.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f6055ccf-5ccd-402b-ab74-72c4dd0c07e8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101092024-11-09T02:56:24.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f6055ccf-5ccd-402b-ab74-72c4dd0c07e8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101102024-11-09T02:56:24.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f6055ccf-5ccd-402b-ab74-72c4dd0c07e8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101112024-11-09T02:56:25.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e844e1e3-9e0d-4d5e-93c5-ba4239257623 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101122024-11-09T02:56:25.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e844e1e3-9e0d-4d5e-93c5-ba4239257623 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101132024-11-09T02:56:25.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e844e1e3-9e0d-4d5e-93c5-ba4239257623 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101142024-11-09T02:56:26.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76efef19-0e9c-4b4d-8c30-aecd7970cb34 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101152024-11-09T02:56:26.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76efef19-0e9c-4b4d-8c30-aecd7970cb34 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101162024-11-09T02:56:26.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76efef19-0e9c-4b4d-8c30-aecd7970cb34 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101172024-11-09T02:56:27.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46190cd8-6f31-4d7a-b883-5ac26a9f5c37 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101182024-11-09T02:56:27.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46190cd8-6f31-4d7a-b883-5ac26a9f5c37 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101192024-11-09T02:56:27.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 46190cd8-6f31-4d7a-b883-5ac26a9f5c37 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101202024-11-09T02:56:28.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9ade397-2a0a-480d-baf0-7672eb6c7b9b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101212024-11-09T02:56:28.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9ade397-2a0a-480d-baf0-7672eb6c7b9b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101222024-11-09T02:56:28.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9ade397-2a0a-480d-baf0-7672eb6c7b9b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101232024-11-09T02:56:30.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be692d2a-1073-40ca-af4c-cf0607e69e1f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101242024-11-09T02:56:30.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be692d2a-1073-40ca-af4c-cf0607e69e1f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101252024-11-09T02:56:30.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be692d2a-1073-40ca-af4c-cf0607e69e1f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101262024-11-09T02:56:30.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 918 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 3829b7d3-b36f-4be8-8c34-bbc8bff342a9 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
101272024-11-09T02:56:31.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eff05e0a-4e2f-47f4-a580-05d589dc0546 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101282024-11-09T02:56:31.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eff05e0a-4e2f-47f4-a580-05d589dc0546 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101292024-11-09T02:56:31.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eff05e0a-4e2f-47f4-a580-05d589dc0546 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101302024-11-09T02:56:32.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b26c85b-f3dd-46d6-8827-00b37df886e1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101312024-11-09T02:56:32.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b26c85b-f3dd-46d6-8827-00b37df886e1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101322024-11-09T02:56:32.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b26c85b-f3dd-46d6-8827-00b37df886e1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101332024-11-09T02:56:33.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 48b6b947-0c68-4a46-986e-11fd6fac4cef roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101342024-11-09T02:56:33.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 48b6b947-0c68-4a46-986e-11fd6fac4cef resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101352024-11-09T02:56:33.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 48b6b947-0c68-4a46-986e-11fd6fac4cef response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
101362024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
101372024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
101382024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101392024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
101402024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101412024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
101422024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101432024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
101442024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101452024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
101462024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
101472024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101482024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
101492024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101502024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101512024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
101522024-11-09T02:56:33.170ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
101532024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101542024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
101552024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101562024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
101572024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
101582024-11-09T02:56:33.170ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
101592024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101602024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
101612024-11-09T02:56:33.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101622024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.311\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
101632024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101642024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
101652024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
101662024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101672024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
101682024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101692024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
101702024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
101712024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101722024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101732024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
101742024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101752024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
101762024-11-09T02:56:33.170ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
101772024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101782024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
101792024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101802024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
101812024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.2\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101822024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
101832024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
101842024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
101852024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
101862024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.19\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
101872024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
101882024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.181\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101892024-11-09T02:56:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
101902024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
101912024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101922024-11-09T02:56:33.171ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
101932024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.59\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
101942024-11-09T02:56:33.171ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
101952024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
101962024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
101972024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101982024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
101992024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102002024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
102012024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102022024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
102032024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102042024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
102052024-11-09T02:56:33.171ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:46:33.170880375 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
102062024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
102072024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102082024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102092024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102102024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102112024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102122024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102132024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102142024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102152024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102162024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
102172024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102182024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102192024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102202024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102212024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
102222024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102232024-11-09T02:56:33.171ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
102242024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102252024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102262024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
102272024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
102282024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
102292024-11-09T02:56:33.171ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 508015087 } })
102302024-11-09T02:56:33.171ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 508018307 } })
102312024-11-09T02:56:33.171ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
102322024-11-09T02:56:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.168834ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
102332024-11-09T02:56:33.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
102342024-11-09T02:56:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.45745ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
102352024-11-09T02:56:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102362024-11-09T02:56:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102372024-11-09T02:56:33.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102382024-11-09T02:56:33.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.505303ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102392024-11-09T02:56:33.176ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102402024-11-09T02:56:33.176ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102412024-11-09T02:56:33.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102422024-11-09T02:56:33.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102432024-11-09T02:56:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102442024-11-09T02:56:33.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102452024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102462024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102472024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102482024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102492024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102502024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102512024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102522024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102532024-11-09T02:56:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102542024-11-09T02:56:33.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102552024-11-09T02:56:33.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102562024-11-09T02:56:33.184ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102572024-11-09T02:56:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102582024-11-09T02:56:33.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102592024-11-09T02:56:33.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102602024-11-09T02:56:33.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102612024-11-09T02:56:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102622024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102632024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102642024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102652024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102662024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102672024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102682024-11-09T02:56:33.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102692024-11-09T02:56:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102702024-11-09T02:56:33.190ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102712024-11-09T02:56:33.191ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102722024-11-09T02:56:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102732024-11-09T02:56:33.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102742024-11-09T02:56:33.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
102752024-11-09T02:56:33.194ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102762024-11-09T02:56:33.194ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 531261647 } })
102772024-11-09T02:56:33.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102782024-11-09T02:56:33.194ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 531443321 } })
102792024-11-09T02:56:33.195ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
102802024-11-09T02:56:33.195ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.363263ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
102812024-11-09T02:56:33.195ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
102822024-11-09T02:56:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102832024-11-09T02:56:33.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102842024-11-09T02:56:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102852024-11-09T02:56:33.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102862024-11-09T02:56:33.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102872024-11-09T02:56:33.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102882024-11-09T02:56:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102892024-11-09T02:56:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102902024-11-09T02:56:33.203ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:46:33.170880375 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
102912024-11-09T02:56:33.203ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 32.39323ms iteration = 11 status = {"expiration":"2024-11-09T02:46:33.170880375Z","pruned":[]}
102922024-11-09T02:56:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102932024-11-09T02:56:33.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102942024-11-09T02:56:33.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102952024-11-09T02:56:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102962024-11-09T02:56:33.206ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102972024-11-09T02:56:33.206ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102982024-11-09T02:56:33.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102992024-11-09T02:56:33.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103002024-11-09T02:56:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103012024-11-09T02:56:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103022024-11-09T02:56:33.209ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
103032024-11-09T02:56:33.209ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
103042024-11-09T02:56:33.209ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
103052024-11-09T02:56:33.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103062024-11-09T02:56:33.209ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 545942671 } })
103072024-11-09T02:56:33.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103082024-11-09T02:56:33.209ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
103092024-11-09T02:56:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103102024-11-09T02:56:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103112024-11-09T02:56:33.214ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103122024-11-09T02:56:33.214ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.963029ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103132024-11-09T02:56:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103142024-11-09T02:56:33.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103152024-11-09T02:56:33.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103162024-11-09T02:56:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103172024-11-09T02:56:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103182024-11-09T02:56:33.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103192024-11-09T02:56:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103202024-11-09T02:56:33.225ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103212024-11-09T02:56:33.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103222024-11-09T02:56:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103232024-11-09T02:56:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103242024-11-09T02:56:33.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103252024-11-09T02:56:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103262024-11-09T02:56:33.232ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
103272024-11-09T02:56:33.232ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
103282024-11-09T02:56:33.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103292024-11-09T02:56:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103302024-11-09T02:56:33.241ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312024-11-09T02:56:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
103322024-11-09T02:56:33.244ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103332024-11-09T02:56:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103342024-11-09T02:56:33.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103352024-11-09T02:56:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103362024-11-09T02:56:33.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103372024-11-09T02:56:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103382024-11-09T02:56:33.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103392024-11-09T02:56:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103402024-11-09T02:56:33.259ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
103412024-11-09T02:56:33.259ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 88.422717ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
103422024-11-09T02:56:33.259ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
103432024-11-09T02:56:33.259ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
103442024-11-09T02:56:33.259ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
103452024-11-09T02:56:33.259ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 89.110892ms iteration = 11 status = {"generation":2}
103462024-11-09T02:56:33.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103472024-11-09T02:56:33.261ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
103482024-11-09T02:56:33.261ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
103492024-11-09T02:56:33.261ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.747156ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
103502024-11-09T02:56:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103512024-11-09T02:56:33.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.957243ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103522024-11-09T02:56:33.267ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
103532024-11-09T02:56:33.267ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
103542024-11-09T02:56:33.267ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
103552024-11-09T02:56:33.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103562024-11-09T02:56:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103572024-11-09T02:56:33.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103582024-11-09T02:56:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103592024-11-09T02:56:33.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103602024-11-09T02:56:33.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103612024-11-09T02:56:33.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103622024-11-09T02:56:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103632024-11-09T02:56:33.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103642024-11-09T02:56:33.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103652024-11-09T02:56:33.273ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(aee3d201-e34c-48bf-ac54-35a88124914c, 0), (ae7eda3c-463c-4531-b460-1654db48aec5, 0), (49c72ac0-6fc5-47c7-a85f-9108666236bb, 0)]
103662024-11-09T02:56:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103672024-11-09T02:56:33.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103682024-11-09T02:56:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103692024-11-09T02:56:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103702024-11-09T02:56:33.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103712024-11-09T02:56:33.273ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 610512315 } })
103722024-11-09T02:56:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103732024-11-09T02:56:33.275ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
103742024-11-09T02:56:33.275ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
103752024-11-09T02:56:33.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103762024-11-09T02:56:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103772024-11-09T02:56:33.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103782024-11-09T02:56:33.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103792024-11-09T02:56:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103802024-11-09T02:56:33.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
103812024-11-09T02:56:33.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103822024-11-09T02:56:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103832024-11-09T02:56:33.280ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
103842024-11-09T02:56:33.280ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
103852024-11-09T02:56:33.280ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.885931ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
103862024-11-09T02:56:33.281ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.662007ms iteration = 21 status = 0
103872024-11-09T02:56:33.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103882024-11-09T02:56:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103892024-11-09T02:56:33.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103902024-11-09T02:56:33.285ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103912024-11-09T02:56:33.285ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103922024-11-09T02:56:33.285ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.67054ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103932024-11-09T02:56:33.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103942024-11-09T02:56:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103952024-11-09T02:56:33.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
103962024-11-09T02:56:33.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103972024-11-09T02:56:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103982024-11-09T02:56:33.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103992024-11-09T02:56:33.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.910299ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104002024-11-09T02:56:33.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104012024-11-09T02:56:33.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104022024-11-09T02:56:33.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104032024-11-09T02:56:33.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104042024-11-09T02:56:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104052024-11-09T02:56:33.294ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104062024-11-09T02:56:33.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104072024-11-09T02:56:33.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104082024-11-09T02:56:33.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104092024-11-09T02:56:33.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
104102024-11-09T02:56:33.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104112024-11-09T02:56:33.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104122024-11-09T02:56:33.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104132024-11-09T02:56:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104142024-11-09T02:56:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
104152024-11-09T02:56:33.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104162024-11-09T02:56:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104172024-11-09T02:56:33.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104182024-11-09T02:56:33.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104192024-11-09T02:56:33.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104202024-11-09T02:56:33.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104212024-11-09T02:56:33.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104222024-11-09T02:56:33.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104232024-11-09T02:56:33.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104242024-11-09T02:56:33.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104252024-11-09T02:56:33.312ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
104262024-11-09T02:56:33.312ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 141.689098ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
104272024-11-09T02:56:33.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104282024-11-09T02:56:33.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104292024-11-09T02:56:33.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104302024-11-09T02:56:33.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104312024-11-09T02:56:33.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104322024-11-09T02:56:33.316ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.819223ms iteration = 23 status = {"physical_disks_added":0}
104332024-11-09T02:56:33.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104342024-11-09T02:56:33.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104352024-11-09T02:56:33.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104362024-11-09T02:56:33.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104372024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
104382024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
104392024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
104402024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 149.879728ms iteration = 11 status = {"generation":1}
104412024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
104422024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104432024-11-09T02:56:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104442024-11-09T02:56:33.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104452024-11-09T02:56:33.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104462024-11-09T02:56:33.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104472024-11-09T02:56:33.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104482024-11-09T02:56:33.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104492024-11-09T02:56:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104502024-11-09T02:56:33.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104512024-11-09T02:56:33.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104522024-11-09T02:56:33.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104532024-11-09T02:56:33.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104542024-11-09T02:56:33.332ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
104552024-11-09T02:56:33.332ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 161.733463ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
104562024-11-09T02:56:33.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104572024-11-09T02:56:33.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104582024-11-09T02:56:33.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104592024-11-09T02:56:33.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
104602024-11-09T02:56:33.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104612024-11-09T02:56:33.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104622024-11-09T02:56:33.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104632024-11-09T02:56:33.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104642024-11-09T02:56:33.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104652024-11-09T02:56:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104662024-11-09T02:56:33.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104672024-11-09T02:56:33.346ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
104682024-11-09T02:56:33.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
104692024-11-09T02:56:33.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104702024-11-09T02:56:33.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104712024-11-09T02:56:33.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104722024-11-09T02:56:33.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104732024-11-09T02:56:33.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104742024-11-09T02:56:33.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104752024-11-09T02:56:33.372ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
104762024-11-09T02:56:33.372ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104772024-11-09T02:56:33.372ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5603637-cb0e-419f-b421-ba059a13b723", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
104782024-11-09T02:56:33.372ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104792024-11-09T02:56:33.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104802024-11-09T02:56:33.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104812024-11-09T02:56:33.377ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104822024-11-09T02:56:33.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104832024-11-09T02:56:33.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104842024-11-09T02:56:33.382ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
104852024-11-09T02:56:33.382ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 211.741356ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
104862024-11-09T02:56:33.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104872024-11-09T02:56:33.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104882024-11-09T02:56:33.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104892024-11-09T02:56:33.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104902024-11-09T02:56:33.410ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
104912024-11-09T02:56:33.444ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
104922024-11-09T02:56:33.444ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104932024-11-09T02:56:33.445ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e89ca929-33a3-4942-920b-1ae7f69c84f8", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
104942024-11-09T02:56:33.445ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104952024-11-09T02:56:33.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104962024-11-09T02:56:33.511ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
104972024-11-09T02:56:33.511ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104982024-11-09T02:56:33.511ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1f2fd6-b77c-4036-bbd3-b1b11957d6bc", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
104992024-11-09T02:56:33.511ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105002024-11-09T02:56:33.513ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
105012024-11-09T02:56:33.568ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
105022024-11-09T02:56:33.568ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
105032024-11-09T02:56:33.568ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
105042024-11-09T02:56:33.569ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1433642-c684-4894-a9d0-d26fc9ee6cd8", "content-length": "476", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105052024-11-09T02:56:33.569ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
105062024-11-09T02:56:33.569ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "890c7e77-de0c-4679-adbc-015f73f734fe", "content-length": "734", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105072024-11-09T02:56:33.569ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
105082024-11-09T02:56:33.569ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d5155f8-9a0e-4d73-84cb-0e5d3193a093", "content-length": "111", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105092024-11-09T02:56:33.569ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
105102024-11-09T02:56:33.570ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1831379b-fe07-4099-b380-01b82832f817", "content-length": "111", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105112024-11-09T02:56:33.570ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
105122024-11-09T02:56:33.570ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "039248a4-9804-4976-9d3a-ea171926b169", "content-length": "167", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105132024-11-09T02:56:33.570ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
105142024-11-09T02:56:33.570ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "015374c2-1161-4aa3-bdb4-b18a8ede8853", "content-length": "167", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105152024-11-09T02:56:33.570ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
105162024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95647b66-e7c5-4749-b1b4-d184a077d698", "content-length": "175", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105172024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
105182024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7393fa21-0a0a-47f3-91f7-6928dbf42c39", "content-length": "175", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105192024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
105202024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0d1130-1a6c-483a-ba25-f357032b8e80", "content-length": "702", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105212024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
105222024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "84817792-6f94-437e-a2d1-81da719ae349", "content-length": "727", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105232024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
105242024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46d01293-d4f5-4a0f-bce3-eec788f1c50a", "content-length": "729", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105252024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
105262024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f89b094e-4a8f-49a2-a620-7a2837c3cf76", "content-length": "728", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105272024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
105282024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c11737c8-511b-4293-b50f-d983d1498d53", "content-length": "722", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105292024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
105302024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb3d1cb1-cc8f-41fc-855d-cca16492764d", "content-length": "109", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105312024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
105322024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "67627c75-dce7-4f0d-9a92-91da73c41d5c", "content-length": "109", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105332024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
105342024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3ac827b-52c1-4fd8-bbb0-a8ec09f8138e", "content-length": "169", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105352024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
105362024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae153965-2f60-4a4d-8785-dc1770b4ea55", "content-length": "169", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105372024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
105382024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0af38ec-2a07-441a-b56d-73b170bd659b", "content-length": "178", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105392024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
105402024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "beac148e-61c1-4bb4-8ffe-16b197191cc9", "content-length": "178", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105412024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
105422024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9f5d97c-9d13-462d-9ad7-d26a707057c3", "content-length": "702", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105432024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
105442024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ecbc8a6-406f-4807-9358-f34de21ca981", "content-length": "727", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105452024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
105462024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bf3105b-ed32-4cb7-8c4b-81e7e61c1c1b", "content-length": "729", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105472024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
105482024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "77f8e14b-bbf6-4673-ade7-36acad97afef", "content-length": "728", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105492024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
105502024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105512024-11-09T02:56:33.598ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
105522024-11-09T02:56:33.636ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
105532024-11-09T02:56:33.637ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a57832bd-df28-4d52-bd7c-66e04aa44a62", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105542024-11-09T02:56:33.637ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105552024-11-09T02:56:33.638ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "14f96736-2628-4974-a639-2ea988ed31d2", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105562024-11-09T02:56:33.638ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105572024-11-09T02:56:33.640ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105582024-11-09T02:56:33.640ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 469.836829ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
105592024-11-09T02:56:33.645ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
105602024-11-09T02:56:33.646ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c91fbe8-9f7d-432d-a091-990fbeb88651", "content-length": "1", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
105612024-11-09T02:56:33.647ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105622024-11-09T02:56:33.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105632024-11-09T02:56:33.688ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
105642024-11-09T02:56:33.688ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105652024-11-09T02:56:33.689ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 518.471495ms iteration = 21 status = {}
105662024-11-09T02:56:33.690ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105672024-11-09T02:56:33.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105682024-11-09T02:56:33.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105692024-11-09T02:56:33.691ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105702024-11-09T02:56:33.692ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105712024-11-09T02:56:33.693ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 522.291704ms iteration = 21 status = null
105722024-11-09T02:56:33.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105732024-11-09T02:56:33.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105742024-11-09T02:56:33.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105752024-11-09T02:56:33.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105762024-11-09T02:56:33.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
105772024-11-09T02:56:33.694ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
105782024-11-09T02:56:33.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105792024-11-09T02:56:33.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105802024-11-09T02:56:33.695ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105812024-11-09T02:56:33.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105822024-11-09T02:56:33.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105832024-11-09T02:56:33.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105842024-11-09T02:56:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105852024-11-09T02:56:33.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
105862024-11-09T02:56:33.698ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
105872024-11-09T02:56:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105882024-11-09T02:56:33.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
105892024-11-09T02:56:33.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105902024-11-09T02:56:33.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105912024-11-09T02:56:33.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105922024-11-09T02:56:33.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105932024-11-09T02:56:33.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105942024-11-09T02:56:33.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105952024-11-09T02:56:33.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105962024-11-09T02:56:33.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
105972024-11-09T02:56:33.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105982024-11-09T02:56:33.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105992024-11-09T02:56:33.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
106002024-11-09T02:56:33.726ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4dbe6ab1-5883-43bd-a980-1f289523958d", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106012024-11-09T02:56:33.726ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106022024-11-09T02:56:33.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "41f6673e-281b-4a92-8e4d-c6358f9ff7fa", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106032024-11-09T02:56:33.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106042024-11-09T02:56:33.731ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6614867f-7e85-4d49-93a7-4c7c21137a21", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106052024-11-09T02:56:33.731ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106062024-11-09T02:56:33.733ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106072024-11-09T02:56:33.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.650198ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
106082024-11-09T02:56:33.747ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52bfa820-bb83-4c3f-8ab0-b7707343298f", "content-length": "372", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106092024-11-09T02:56:33.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106102024-11-09T02:56:33.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106112024-11-09T02:56:33.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106122024-11-09T02:56:33.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106132024-11-09T02:56:33.875ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106142024-11-09T02:56:33.879ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b19854-81bc-473a-baa8-473cbf5cdc6e", "content-length": "691", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106152024-11-09T02:56:33.879ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
106162024-11-09T02:56:33.879ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
106172024-11-09T02:56:33.879ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
106182024-11-09T02:56:33.880ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 710.259478ms iteration = 21 status = {}
106192024-11-09T02:56:33.881ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
106202024-11-09T02:56:33.881ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
106212024-11-09T02:56:33.884ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
106222024-11-09T02:56:33.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106232024-11-09T02:56:33.884ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
106242024-11-09T02:56:33.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106252024-11-09T02:56:33.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106262024-11-09T02:56:33.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106272024-11-09T02:56:33.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106282024-11-09T02:56:33.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
106292024-11-09T02:56:33.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106302024-11-09T02:56:33.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106312024-11-09T02:56:33.890ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
106322024-11-09T02:56:33.890ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
106332024-11-09T02:56:33.890ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
106342024-11-09T02:56:33.890ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106352024-11-09T02:56:33.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce3006d0-93f9-4fe1-8181-22339302471f", "content-length": "134", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106362024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106372024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
106382024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106392024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106402024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106412024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106422024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106432024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106442024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106452024-11-09T02:56:33.891ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106462024-11-09T02:56:33.892ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
106472024-11-09T02:56:33.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106482024-11-09T02:56:33.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106492024-11-09T02:56:33.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106502024-11-09T02:56:33.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5e11a6c-d6b3-4ee7-a315-046c8942eb1f", "content-length": "2", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106512024-11-09T02:56:33.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106522024-11-09T02:56:33.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3a42569-fa9c-4dd4-ade8-29b91fa4786d", "content-length": "52", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106532024-11-09T02:56:33.894ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
106542024-11-09T02:56:33.894ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106552024-11-09T02:56:33.922ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
106562024-11-09T02:56:33.922ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106572024-11-09T02:56:33.941ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
106582024-11-09T02:56:33.941ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
106592024-11-09T02:56:33.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106602024-11-09T02:56:33.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106612024-11-09T02:56:33.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106622024-11-09T02:56:33.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106632024-11-09T02:56:33.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106642024-11-09T02:56:33.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
106652024-11-09T02:56:33.978ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
106662024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9905a179-3fb8-4b1e-80b5-f526338fa8ac", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106672024-11-09T02:56:34.008ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
106682024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
106692024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d8899fa9-ec6f-42af-be0e-1277e34e5826", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106702024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106712024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106722024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b11b9b5-bec6-4790-9a9a-f0202e7b1d72", "content-length": "682", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106732024-11-09T02:56:34.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106742024-11-09T02:56:34.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106752024-11-09T02:56:34.009ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1c63ada4-5c68-498b-8a10-82182456284f", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106762024-11-09T02:56:34.010ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
106772024-11-09T02:56:34.010ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 839.947949ms
106782024-11-09T02:56:34.010ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 839.958929ms iteration = 3 status = {}
106792024-11-09T02:56:34.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106802024-11-09T02:56:34.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106812024-11-09T02:56:34.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106822024-11-09T02:56:34.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106832024-11-09T02:56:34.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106842024-11-09T02:56:34.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106852024-11-09T02:56:34.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106862024-11-09T02:56:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106872024-11-09T02:56:34.019ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106882024-11-09T02:56:34.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106892024-11-09T02:56:34.019ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106902024-11-09T02:56:34.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106912024-11-09T02:56:34.019ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "57105e40-739c-4e0f-9f0f-9c61fe41b789", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
106922024-11-09T02:56:34.022ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 851.481977ms iteration = 21 status = {}
106932024-11-09T02:56:34.027ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 856.880688ms iteration = 21 status = {}
106942024-11-09T02:56:34.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9ef06952-0f1c-4655-8cd0-856d446f8b43 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
106952024-11-09T02:56:34.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9ef06952-0f1c-4655-8cd0-856d446f8b43 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
106962024-11-09T02:56:34.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9ef06952-0f1c-4655-8cd0-856d446f8b43 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
106972024-11-09T02:56:34.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e33ffbb4-2d1a-4a75-a508-7b691d14831d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
106982024-11-09T02:56:34.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e33ffbb4-2d1a-4a75-a508-7b691d14831d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
106992024-11-09T02:56:34.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e33ffbb4-2d1a-4a75-a508-7b691d14831d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
107002024-11-09T02:56:34.471ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "f126b640-c0bb-4fc5-873b-566fca0db39f", "content-length": "29193", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
107012024-11-09T02:56:34.473ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
107022024-11-09T02:56:34.475ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107032024-11-09T02:56:34.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107042024-11-09T02:56:34.477ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107052024-11-09T02:56:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
107062024-11-09T02:56:34.478ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107072024-11-09T02:56:34.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107082024-11-09T02:56:34.622ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = aa017116-f803-4be4-8d63-f007cb68c360 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
107092024-11-09T02:56:34.622ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = aa017116-f803-4be4-8d63-f007cb68c360 time_started = 2024-11-09 02:56:33.568501 UTC
107102024-11-09T02:56:34.622ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.452297652s iteration = 3 status = {"collection_id":"aa017116-f803-4be4-8d63-f007cb68c360","time_done":"2024-11-09 02:56:34.473253 UTC","time_started":"2024-11-09 02:56:33.568501 UTC"}
107112024-11-09T02:56:34.622ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
107122024-11-09T02:56:34.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107132024-11-09T02:56:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107142024-11-09T02:56:34.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107152024-11-09T02:56:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107162024-11-09T02:56:34.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107172024-11-09T02:56:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107182024-11-09T02:56:34.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107192024-11-09T02:56:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107202024-11-09T02:56:34.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107212024-11-09T02:56:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107222024-11-09T02:56:34.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107232024-11-09T02:56:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107242024-11-09T02:56:34.651ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 28.293785ms iteration = 24 status = {"physical_disks_added":0}
107252024-11-09T02:56:35.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 687195d5-824d-4f72-8eed-d793456d48df roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107262024-11-09T02:56:35.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 687195d5-824d-4f72-8eed-d793456d48df resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107272024-11-09T02:56:35.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 687195d5-824d-4f72-8eed-d793456d48df response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107282024-11-09T02:56:36.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0f6ecf2b-dfe6-4aef-b763-5e66939606a6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107292024-11-09T02:56:36.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0f6ecf2b-dfe6-4aef-b763-5e66939606a6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107302024-11-09T02:56:36.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0f6ecf2b-dfe6-4aef-b763-5e66939606a6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107312024-11-09T02:56:37.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c8884733-2eed-4b7f-b4db-3aaa4a8a6e44 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107322024-11-09T02:56:37.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c8884733-2eed-4b7f-b4db-3aaa4a8a6e44 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107332024-11-09T02:56:37.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c8884733-2eed-4b7f-b4db-3aaa4a8a6e44 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107342024-11-09T02:56:38.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cde93eca-53ec-428c-ba31-ea7aa54663c2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107352024-11-09T02:56:38.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cde93eca-53ec-428c-ba31-ea7aa54663c2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107362024-11-09T02:56:38.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cde93eca-53ec-428c-ba31-ea7aa54663c2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107372024-11-09T02:56:39.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4495ede5-cdc1-4456-b818-fae339a87c31 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107382024-11-09T02:56:39.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4495ede5-cdc1-4456-b818-fae339a87c31 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107392024-11-09T02:56:39.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4495ede5-cdc1-4456-b818-fae339a87c31 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107402024-11-09T02:56:40.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12fe79b0-adc3-4929-90d5-984e8f12363b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107412024-11-09T02:56:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12fe79b0-adc3-4929-90d5-984e8f12363b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107422024-11-09T02:56:40.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12fe79b0-adc3-4929-90d5-984e8f12363b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107432024-11-09T02:56:41.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79e486da-7b4d-4dbe-bd45-c0c032daa500 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107442024-11-09T02:56:41.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79e486da-7b4d-4dbe-bd45-c0c032daa500 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107452024-11-09T02:56:41.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79e486da-7b4d-4dbe-bd45-c0c032daa500 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107462024-11-09T02:56:42.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ec081b5-b557-4dd4-90fd-ef034f381ab4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107472024-11-09T02:56:42.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ec081b5-b557-4dd4-90fd-ef034f381ab4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107482024-11-09T02:56:42.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1ec081b5-b557-4dd4-90fd-ef034f381ab4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107492024-11-09T02:56:43.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
107502024-11-09T02:56:43.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
107512024-11-09T02:56:43.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107522024-11-09T02:56:43.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107532024-11-09T02:56:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107542024-11-09T02:56:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107552024-11-09T02:56:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107562024-11-09T02:56:43.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107572024-11-09T02:56:43.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107582024-11-09T02:56:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107592024-11-09T02:56:43.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107602024-11-09T02:56:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107612024-11-09T02:56:43.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.660446ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107622024-11-09T02:56:43.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107632024-11-09T02:56:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107642024-11-09T02:56:43.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107652024-11-09T02:56:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
107662024-11-09T02:56:43.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107672024-11-09T02:56:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107682024-11-09T02:56:43.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
107692024-11-09T02:56:43.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.077205ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
107702024-11-09T02:56:43.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2109870e-d3c5-4376-b40a-58448708af10 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107712024-11-09T02:56:43.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2109870e-d3c5-4376-b40a-58448708af10 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107722024-11-09T02:56:43.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2109870e-d3c5-4376-b40a-58448708af10 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107732024-11-09T02:56:44.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c8f25899-1110-4c68-8087-f1db3d3c068b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107742024-11-09T02:56:44.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c8f25899-1110-4c68-8087-f1db3d3c068b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107752024-11-09T02:56:44.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c8f25899-1110-4c68-8087-f1db3d3c068b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107762024-11-09T02:56:45.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 868 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = a1c52227-497d-48a7-9ebc-6480b6ed3acd response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
107772024-11-09T02:56:45.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa89a70b-5efc-4779-8fd6-06160ec60123 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107782024-11-09T02:56:45.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa89a70b-5efc-4779-8fd6-06160ec60123 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107792024-11-09T02:56:45.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa89a70b-5efc-4779-8fd6-06160ec60123 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107802024-11-09T02:56:46.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53d7375b-9ac9-4824-8d63-d4bd869be3c0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107812024-11-09T02:56:46.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53d7375b-9ac9-4824-8d63-d4bd869be3c0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107822024-11-09T02:56:46.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53d7375b-9ac9-4824-8d63-d4bd869be3c0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107832024-11-09T02:56:47.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e8137e05-53d6-432c-a4ce-fa96c643082f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107842024-11-09T02:56:47.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e8137e05-53d6-432c-a4ce-fa96c643082f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107852024-11-09T02:56:47.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e8137e05-53d6-432c-a4ce-fa96c643082f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107862024-11-09T02:56:48.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90abafae-1ab8-4c2f-833c-9378edc40259 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107872024-11-09T02:56:48.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90abafae-1ab8-4c2f-833c-9378edc40259 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107882024-11-09T02:56:48.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90abafae-1ab8-4c2f-833c-9378edc40259 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107892024-11-09T02:56:49.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 21574d2f-572e-488f-b53f-1fb778cda2cc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107902024-11-09T02:56:49.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 21574d2f-572e-488f-b53f-1fb778cda2cc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107912024-11-09T02:56:49.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 21574d2f-572e-488f-b53f-1fb778cda2cc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107922024-11-09T02:56:50.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b15596c5-d7ef-4c72-afd6-af4a38dd8d8d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107932024-11-09T02:56:50.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b15596c5-d7ef-4c72-afd6-af4a38dd8d8d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107942024-11-09T02:56:50.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b15596c5-d7ef-4c72-afd6-af4a38dd8d8d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107952024-11-09T02:56:51.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81582a4a-eb06-47f1-842d-650977518958 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107962024-11-09T02:56:51.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81582a4a-eb06-47f1-842d-650977518958 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107972024-11-09T02:56:51.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81582a4a-eb06-47f1-842d-650977518958 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107982024-11-09T02:56:52.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efaf15c4-fa64-45a3-985f-0e73903f4645 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
107992024-11-09T02:56:52.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efaf15c4-fa64-45a3-985f-0e73903f4645 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108002024-11-09T02:56:52.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efaf15c4-fa64-45a3-985f-0e73903f4645 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108012024-11-09T02:56:53.169ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
108022024-11-09T02:56:53.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
108032024-11-09T02:56:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108042024-11-09T02:56:53.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108052024-11-09T02:56:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108062024-11-09T02:56:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108072024-11-09T02:56:53.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108082024-11-09T02:56:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108092024-11-09T02:56:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108102024-11-09T02:56:53.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.164986ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108112024-11-09T02:56:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108122024-11-09T02:56:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108132024-11-09T02:56:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108142024-11-09T02:56:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108152024-11-09T02:56:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108162024-11-09T02:56:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108172024-11-09T02:56:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
108182024-11-09T02:56:53.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108192024-11-09T02:56:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108202024-11-09T02:56:53.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
108212024-11-09T02:56:53.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.983633ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
108222024-11-09T02:56:53.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b10c1740-6265-403e-bfbe-e4a85e081c0f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108232024-11-09T02:56:53.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b10c1740-6265-403e-bfbe-e4a85e081c0f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108242024-11-09T02:56:53.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b10c1740-6265-403e-bfbe-e4a85e081c0f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108252024-11-09T02:56:54.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9361063e-b961-4bc8-abae-a50cd32afbe0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108262024-11-09T02:56:54.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9361063e-b961-4bc8-abae-a50cd32afbe0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108272024-11-09T02:56:54.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9361063e-b961-4bc8-abae-a50cd32afbe0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108282024-11-09T02:56:55.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d4588f5b-afde-4ed1-8010-b81e989628d0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108292024-11-09T02:56:55.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d4588f5b-afde-4ed1-8010-b81e989628d0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108302024-11-09T02:56:55.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d4588f5b-afde-4ed1-8010-b81e989628d0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108312024-11-09T02:56:56.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b463668-b507-4fb0-a5e8-bda9d5c1a4a7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108322024-11-09T02:56:56.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b463668-b507-4fb0-a5e8-bda9d5c1a4a7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108332024-11-09T02:56:56.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6b463668-b507-4fb0-a5e8-bda9d5c1a4a7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108342024-11-09T02:56:57.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90a124c1-1817-44f2-9aaf-5e85f6be7c54 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108352024-11-09T02:56:57.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90a124c1-1817-44f2-9aaf-5e85f6be7c54 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108362024-11-09T02:56:57.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90a124c1-1817-44f2-9aaf-5e85f6be7c54 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108372024-11-09T02:56:58.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 422d2616-afdf-4cf0-93cf-fb9f14c7fb28 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108382024-11-09T02:56:58.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 422d2616-afdf-4cf0-93cf-fb9f14c7fb28 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108392024-11-09T02:56:58.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 422d2616-afdf-4cf0-93cf-fb9f14c7fb28 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108402024-11-09T02:56:59.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6340dd94-3bca-49d5-9201-ea07a0e3984e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108412024-11-09T02:56:59.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6340dd94-3bca-49d5-9201-ea07a0e3984e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108422024-11-09T02:56:59.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6340dd94-3bca-49d5-9201-ea07a0e3984e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108432024-11-09T02:57:00.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 767 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 533b3f14-4bcf-4695-8981-430dfecbfaa2 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
108442024-11-09T02:57:00.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b5a982ad-80ff-45e6-81c9-8b907a6de6f2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108452024-11-09T02:57:00.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b5a982ad-80ff-45e6-81c9-8b907a6de6f2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108462024-11-09T02:57:00.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b5a982ad-80ff-45e6-81c9-8b907a6de6f2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108472024-11-09T02:57:01.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90728424-4a71-4d1c-b4df-f3db4311148c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108482024-11-09T02:57:01.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90728424-4a71-4d1c-b4df-f3db4311148c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108492024-11-09T02:57:01.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90728424-4a71-4d1c-b4df-f3db4311148c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108502024-11-09T02:57:02.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cfe92d7f-7ea3-4543-84e9-d32665bf087f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108512024-11-09T02:57:02.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cfe92d7f-7ea3-4543-84e9-d32665bf087f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108522024-11-09T02:57:02.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cfe92d7f-7ea3-4543-84e9-d32665bf087f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
108532024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
108542024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108552024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
108562024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
108572024-11-09T02:57:03.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108582024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108592024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108602024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
108612024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
108622024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108632024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108642024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
108652024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108662024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
108672024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108682024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
108692024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108702024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108712024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
108722024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
108732024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
108742024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108752024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108762024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108772024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
108782024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108792024-11-09T02:57:03.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
108802024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108812024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108822024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108832024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108842024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108852024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108862024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108872024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108882024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108892024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108902024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108912024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108922024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
108932024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
108942024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.28\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
108952024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.66\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
108962024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
108972024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
108982024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.94\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
108992024-11-09T02:57:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.73\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
109002024-11-09T02:57:03.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109012024-11-09T02:57:03.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 510186432 } })
109022024-11-09T02:57:03.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109032024-11-09T02:57:03.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
109042024-11-09T02:57:03.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109052024-11-09T02:57:03.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109062024-11-09T02:57:03.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109072024-11-09T02:57:03.176ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.381812ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
109082024-11-09T02:57:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109092024-11-09T02:57:03.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109102024-11-09T02:57:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109112024-11-09T02:57:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109122024-11-09T02:57:03.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109132024-11-09T02:57:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109142024-11-09T02:57:03.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109152024-11-09T02:57:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
109162024-11-09T02:57:03.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109172024-11-09T02:57:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109182024-11-09T02:57:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109192024-11-09T02:57:03.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109202024-11-09T02:57:03.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109212024-11-09T02:57:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109222024-11-09T02:57:03.184ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 521068587 } })
109232024-11-09T02:57:03.185ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
109242024-11-09T02:57:03.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109252024-11-09T02:57:03.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109262024-11-09T02:57:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109272024-11-09T02:57:03.186ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109282024-11-09T02:57:03.186ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
109292024-11-09T02:57:03.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109302024-11-09T02:57:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109312024-11-09T02:57:03.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109322024-11-09T02:57:03.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.576175ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109332024-11-09T02:57:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109342024-11-09T02:57:03.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109352024-11-09T02:57:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109362024-11-09T02:57:03.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109372024-11-09T02:57:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109382024-11-09T02:57:03.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109392024-11-09T02:57:03.197ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 533760939 } })
109402024-11-09T02:57:03.197ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
109412024-11-09T02:57:03.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109422024-11-09T02:57:03.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109432024-11-09T02:57:03.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109442024-11-09T02:57:03.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109452024-11-09T02:57:03.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109462024-11-09T02:57:03.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109472024-11-09T02:57:03.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109482024-11-09T02:57:03.201ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
109492024-11-09T02:57:03.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.817206ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
109502024-11-09T02:57:03.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109512024-11-09T02:57:03.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109522024-11-09T02:57:03.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109532024-11-09T02:57:03.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109542024-11-09T02:57:03.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109552024-11-09T02:57:03.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
109562024-11-09T02:57:03.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109572024-11-09T02:57:03.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109582024-11-09T02:57:03.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109592024-11-09T02:57:03.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109602024-11-09T02:57:03.217ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.93045ms iteration = 25 status = {"physical_disks_added":0}
109612024-11-09T02:57:03.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109622024-11-09T02:57:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109632024-11-09T02:57:03.230ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109642024-11-09T02:57:03.230ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109652024-11-09T02:57:03.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109662024-11-09T02:57:03.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109672024-11-09T02:57:03.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
109682024-11-09T02:57:03.256ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109692024-11-09T02:57:03.257ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f87e824b-e65c-46d4-a8ee-016565dec30e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
109702024-11-09T02:57:03.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109712024-11-09T02:57:03.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109722024-11-09T02:57:03.276ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
109732024-11-09T02:57:03.276ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109742024-11-09T02:57:03.276ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "668bd27d-9923-484a-a7b7-d88fefd51744", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
109752024-11-09T02:57:03.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109762024-11-09T02:57:03.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109772024-11-09T02:57:03.292ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
109782024-11-09T02:57:03.292ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109792024-11-09T02:57:03.292ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ace5168-8c21-47ef-b30b-483e2459cf26", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
109802024-11-09T02:57:03.292ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109812024-11-09T02:57:03.293ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
109822024-11-09T02:57:03.313ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109832024-11-09T02:57:03.313ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109842024-11-09T02:57:03.313ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e485963-8c64-4366-b935-ebe1a8fdde29", "content-length": "372", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
109852024-11-09T02:57:03.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109862024-11-09T02:57:03.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109872024-11-09T02:57:03.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.381625ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109882024-11-09T02:57:03.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109892024-11-09T02:57:03.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109902024-11-09T02:57:03.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109912024-11-09T02:57:03.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109922024-11-09T02:57:03.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109932024-11-09T02:57:03.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
109942024-11-09T02:57:03.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109952024-11-09T02:57:03.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109962024-11-09T02:57:03.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
109972024-11-09T02:57:03.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 151.500871ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
109982024-11-09T02:57:03.323ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 152.750616ms iteration = 22 status = 0
109992024-11-09T02:57:03.347ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110002024-11-09T02:57:03.348ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4244fac0-e049-4a9e-a820-816f3f9f37a5", "content-length": "1", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
110012024-11-09T02:57:03.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110022024-11-09T02:57:03.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110032024-11-09T02:57:03.352ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.872979ms iteration = 22 status = null
110042024-11-09T02:57:03.360ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110052024-11-09T02:57:03.360ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110062024-11-09T02:57:03.360ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 189.388724ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110072024-11-09T02:57:03.361ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.066219ms iteration = 22 status = {}
110082024-11-09T02:57:03.364ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
110092024-11-09T02:57:03.364ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110102024-11-09T02:57:03.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110112024-11-09T02:57:03.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110122024-11-09T02:57:03.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110132024-11-09T02:57:03.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110142024-11-09T02:57:03.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110152024-11-09T02:57:03.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110162024-11-09T02:57:03.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110172024-11-09T02:57:03.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110182024-11-09T02:57:03.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110192024-11-09T02:57:03.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110202024-11-09T02:57:03.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110212024-11-09T02:57:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110222024-11-09T02:57:03.436ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
110232024-11-09T02:57:03.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110242024-11-09T02:57:03.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110252024-11-09T02:57:03.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
110262024-11-09T02:57:03.447ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa5eff2-de2b-4a14-8342-86df0f6a2a64", "content-length": "134", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
110272024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
110282024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
110292024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110302024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110312024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110322024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110332024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110342024-11-09T02:57:03.447ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110352024-11-09T02:57:03.448ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110362024-11-09T02:57:03.448ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110372024-11-09T02:57:03.448ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
110382024-11-09T02:57:03.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110392024-11-09T02:57:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110402024-11-09T02:57:03.450ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110412024-11-09T02:57:03.450ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1edf204b-35ed-4673-999f-6325320c4c92", "content-length": "2", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
110422024-11-09T02:57:03.450ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110432024-11-09T02:57:03.450ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "20f0de2e-36da-4782-9698-97b0ac4ec2b2", "content-length": "52", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
110442024-11-09T02:57:03.450ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
110452024-11-09T02:57:03.450ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110462024-11-09T02:57:03.453ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "86b31d7d-2ae7-42a2-9d2f-dc3fa9b62eaa", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
110472024-11-09T02:57:03.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110482024-11-09T02:57:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110492024-11-09T02:57:03.459ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110502024-11-09T02:57:03.460ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d61b446-61a3-4c45-a5a8-55c888337722", "content-length": "691", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
110512024-11-09T02:57:03.460ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
110522024-11-09T02:57:03.460ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
110532024-11-09T02:57:03.460ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
110542024-11-09T02:57:03.462ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.3317ms iteration = 22 status = {}
110552024-11-09T02:57:03.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110562024-11-09T02:57:03.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110572024-11-09T02:57:03.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110582024-11-09T02:57:03.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110592024-11-09T02:57:03.469ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110602024-11-09T02:57:03.469ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110612024-11-09T02:57:03.470ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79101e9a-89a7-48ac-a11d-b7305ee5912e", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
110622024-11-09T02:57:03.471ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.790285ms iteration = 22 status = {}
110632024-11-09T02:57:03.566ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a58bee2a-027d-4607-8c98-d59d90014a75", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
110642024-11-09T02:57:03.566ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
110652024-11-09T02:57:03.566ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110662024-11-09T02:57:03.570ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c788a6e5-6057-4acd-8450-5d7e8d66c776", "content-length": "682", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
110672024-11-09T02:57:03.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110682024-11-09T02:57:03.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110692024-11-09T02:57:03.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110702024-11-09T02:57:03.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110712024-11-09T02:57:03.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110722024-11-09T02:57:03.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110732024-11-09T02:57:03.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110742024-11-09T02:57:03.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110752024-11-09T02:57:03.586ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 415.484416ms iteration = 22 status = {}
110762024-11-09T02:57:03.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c66ee556-93a3-43cc-8a76-57319eaf8b8d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110772024-11-09T02:57:03.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c66ee556-93a3-43cc-8a76-57319eaf8b8d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110782024-11-09T02:57:03.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c66ee556-93a3-43cc-8a76-57319eaf8b8d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110792024-11-09T02:57:04.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 28463178-36b0-4f93-aaed-c8d570a9402b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
110802024-11-09T02:57:04.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 28463178-36b0-4f93-aaed-c8d570a9402b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
110812024-11-09T02:57:04.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 28463178-36b0-4f93-aaed-c8d570a9402b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
110822024-11-09T02:57:04.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a560abd2-bccb-4a12-a035-5d9ec70fc02d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110832024-11-09T02:57:04.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a560abd2-bccb-4a12-a035-5d9ec70fc02d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110842024-11-09T02:57:04.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a560abd2-bccb-4a12-a035-5d9ec70fc02d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110852024-11-09T02:57:05.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d241709-e41a-4a38-b02f-d827bc5cd6dc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110862024-11-09T02:57:05.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d241709-e41a-4a38-b02f-d827bc5cd6dc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110872024-11-09T02:57:05.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d241709-e41a-4a38-b02f-d827bc5cd6dc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110882024-11-09T02:57:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 763bf2ae-5faf-4921-90f7-f7f23b3e5314 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110892024-11-09T02:57:06.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 763bf2ae-5faf-4921-90f7-f7f23b3e5314 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110902024-11-09T02:57:06.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 763bf2ae-5faf-4921-90f7-f7f23b3e5314 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110912024-11-09T02:57:07.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55afedb2-b487-4524-aed4-a2a8aa4196a1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110922024-11-09T02:57:07.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55afedb2-b487-4524-aed4-a2a8aa4196a1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110932024-11-09T02:57:07.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 55afedb2-b487-4524-aed4-a2a8aa4196a1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110942024-11-09T02:57:08.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4276e16e-c3f5-42bf-8c35-98aa6f0d30c4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110952024-11-09T02:57:08.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4276e16e-c3f5-42bf-8c35-98aa6f0d30c4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110962024-11-09T02:57:08.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4276e16e-c3f5-42bf-8c35-98aa6f0d30c4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110972024-11-09T02:57:09.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cfe8268e-9643-4bbe-8849-2bc546f24f96 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110982024-11-09T02:57:09.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cfe8268e-9643-4bbe-8849-2bc546f24f96 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
110992024-11-09T02:57:09.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cfe8268e-9643-4bbe-8849-2bc546f24f96 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111002024-11-09T02:57:10.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90af8703-5dcd-429e-835c-ce273249e3dc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111012024-11-09T02:57:10.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90af8703-5dcd-429e-835c-ce273249e3dc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111022024-11-09T02:57:10.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90af8703-5dcd-429e-835c-ce273249e3dc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111032024-11-09T02:57:11.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6bb353f6-484b-4994-9ddf-f901af84f7d3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111042024-11-09T02:57:11.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6bb353f6-484b-4994-9ddf-f901af84f7d3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111052024-11-09T02:57:11.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6bb353f6-484b-4994-9ddf-f901af84f7d3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111062024-11-09T02:57:13.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98a91a58-20dd-4f01-b583-b773f79c6375 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111072024-11-09T02:57:13.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98a91a58-20dd-4f01-b583-b773f79c6375 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111082024-11-09T02:57:13.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98a91a58-20dd-4f01-b583-b773f79c6375 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111092024-11-09T02:57:13.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
111102024-11-09T02:57:13.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
111112024-11-09T02:57:13.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111122024-11-09T02:57:13.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111132024-11-09T02:57:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111142024-11-09T02:57:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111152024-11-09T02:57:13.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111162024-11-09T02:57:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111172024-11-09T02:57:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111182024-11-09T02:57:13.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.633895ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111192024-11-09T02:57:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111202024-11-09T02:57:13.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111212024-11-09T02:57:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111222024-11-09T02:57:13.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111232024-11-09T02:57:13.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111242024-11-09T02:57:13.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111252024-11-09T02:57:13.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
111262024-11-09T02:57:13.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111272024-11-09T02:57:13.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111282024-11-09T02:57:13.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
111292024-11-09T02:57:13.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.118747ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
111302024-11-09T02:57:14.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2204bed8-e8c5-49a8-8dbd-480a6d6e93d1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111312024-11-09T02:57:14.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2204bed8-e8c5-49a8-8dbd-480a6d6e93d1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111322024-11-09T02:57:14.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2204bed8-e8c5-49a8-8dbd-480a6d6e93d1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111332024-11-09T02:57:15.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4f424c4c-0987-46fd-b8e9-0d7e10f5709a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111342024-11-09T02:57:15.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4f424c4c-0987-46fd-b8e9-0d7e10f5709a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111352024-11-09T02:57:15.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4f424c4c-0987-46fd-b8e9-0d7e10f5709a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111362024-11-09T02:57:15.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 780 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = be12a9a2-169b-4fe3-9e6c-79cc6274ae5e response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
111372024-11-09T02:57:16.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3cf12f88-a862-4d46-a754-cd7b35f49956 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111382024-11-09T02:57:16.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3cf12f88-a862-4d46-a754-cd7b35f49956 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111392024-11-09T02:57:16.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3cf12f88-a862-4d46-a754-cd7b35f49956 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111402024-11-09T02:57:17.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 198bf189-060b-490e-bba1-d88b39fee1ce roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111412024-11-09T02:57:17.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 198bf189-060b-490e-bba1-d88b39fee1ce resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111422024-11-09T02:57:17.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 198bf189-060b-490e-bba1-d88b39fee1ce response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111432024-11-09T02:57:18.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ceb890bc-8574-4897-9cfa-3ea65f3cc802 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111442024-11-09T02:57:18.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ceb890bc-8574-4897-9cfa-3ea65f3cc802 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111452024-11-09T02:57:18.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ceb890bc-8574-4897-9cfa-3ea65f3cc802 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111462024-11-09T02:57:19.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 936cd7d9-1af2-482d-9425-e0975f7d524b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111472024-11-09T02:57:19.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 936cd7d9-1af2-482d-9425-e0975f7d524b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111482024-11-09T02:57:19.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 936cd7d9-1af2-482d-9425-e0975f7d524b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111492024-11-09T02:57:20.144ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:41119
111502024-11-09T02:57:20.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 434c9f57-e379-48ad-8b15-1b5020a4b4dc roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
111512024-11-09T02:57:20.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 434c9f57-e379-48ad-8b15-1b5020a4b4dc resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
111522024-11-09T02:57:20.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 434c9f57-e379-48ad-8b15-1b5020a4b4dc response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
111532024-11-09T02:57:20.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 472b8aac-de27-486d-8804-525260bc40fc roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
111542024-11-09T02:57:20.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 472b8aac-de27-486d-8804-525260bc40fc resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
111552024-11-09T02:57:20.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 472b8aac-de27-486d-8804-525260bc40fc response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
111562024-11-09T02:57:20.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b741df3-c7b2-4afb-b418-a72139f94843 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111572024-11-09T02:57:20.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b741df3-c7b2-4afb-b418-a72139f94843 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111582024-11-09T02:57:20.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7b741df3-c7b2-4afb-b418-a72139f94843 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111592024-11-09T02:57:21.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93c84245-3a91-4593-b344-5594a92c2565 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111602024-11-09T02:57:21.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93c84245-3a91-4593-b344-5594a92c2565 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111612024-11-09T02:57:21.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 93c84245-3a91-4593-b344-5594a92c2565 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111622024-11-09T02:57:22.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d08a6ef-df14-4079-abfb-0411d2b52a44 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111632024-11-09T02:57:22.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d08a6ef-df14-4079-abfb-0411d2b52a44 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111642024-11-09T02:57:22.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d08a6ef-df14-4079-abfb-0411d2b52a44 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111652024-11-09T02:57:23.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
111662024-11-09T02:57:23.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
111672024-11-09T02:57:23.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111682024-11-09T02:57:23.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111692024-11-09T02:57:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111702024-11-09T02:57:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111712024-11-09T02:57:23.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111722024-11-09T02:57:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111732024-11-09T02:57:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111742024-11-09T02:57:23.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.665865ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111752024-11-09T02:57:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111762024-11-09T02:57:23.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111772024-11-09T02:57:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111782024-11-09T02:57:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111792024-11-09T02:57:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111802024-11-09T02:57:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111812024-11-09T02:57:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
111822024-11-09T02:57:23.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111832024-11-09T02:57:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111842024-11-09T02:57:23.189ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
111852024-11-09T02:57:23.189ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.998183ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
111862024-11-09T02:57:23.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb9aea18-8a24-4369-8f5c-abbff1a22320 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111872024-11-09T02:57:23.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb9aea18-8a24-4369-8f5c-abbff1a22320 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111882024-11-09T02:57:23.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cb9aea18-8a24-4369-8f5c-abbff1a22320 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111892024-11-09T02:57:24.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e441df8b-077e-4ede-b7ae-b1e72c8bcb91 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111902024-11-09T02:57:24.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e441df8b-077e-4ede-b7ae-b1e72c8bcb91 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111912024-11-09T02:57:24.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e441df8b-077e-4ede-b7ae-b1e72c8bcb91 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111922024-11-09T02:57:25.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 57aa0cd7-95ed-4cb3-bc89-0bc47b4e1a54 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111932024-11-09T02:57:25.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 57aa0cd7-95ed-4cb3-bc89-0bc47b4e1a54 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111942024-11-09T02:57:25.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 57aa0cd7-95ed-4cb3-bc89-0bc47b4e1a54 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111952024-11-09T02:57:26.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cb986e8-32b1-4230-9057-f0582792c683 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111962024-11-09T02:57:26.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cb986e8-32b1-4230-9057-f0582792c683 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111972024-11-09T02:57:26.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0cb986e8-32b1-4230-9057-f0582792c683 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111982024-11-09T02:57:27.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ded31278-69e3-49e4-a606-7a05003eabc5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
111992024-11-09T02:57:27.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ded31278-69e3-49e4-a606-7a05003eabc5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112002024-11-09T02:57:27.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ded31278-69e3-49e4-a606-7a05003eabc5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112012024-11-09T02:57:28.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c8cb653-66db-4afc-bfbc-c83e5b58be94 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112022024-11-09T02:57:28.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c8cb653-66db-4afc-bfbc-c83e5b58be94 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112032024-11-09T02:57:28.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c8cb653-66db-4afc-bfbc-c83e5b58be94 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112042024-11-09T02:57:29.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bbd6426e-24a4-4ad8-8eb3-3cc3f2220992 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112052024-11-09T02:57:29.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bbd6426e-24a4-4ad8-8eb3-3cc3f2220992 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112062024-11-09T02:57:29.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bbd6426e-24a4-4ad8-8eb3-3cc3f2220992 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112072024-11-09T02:57:30.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 493 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 86b8c3f0-8b97-4b2b-913b-bafc6fb204eb response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
112082024-11-09T02:57:30.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7b923a5-b135-4ca9-8ee1-6fef116a413f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112092024-11-09T02:57:30.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7b923a5-b135-4ca9-8ee1-6fef116a413f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112102024-11-09T02:57:30.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f7b923a5-b135-4ca9-8ee1-6fef116a413f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112112024-11-09T02:57:31.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cad0f2f5-9d75-4280-bc1a-9015d86ab8f9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112122024-11-09T02:57:31.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cad0f2f5-9d75-4280-bc1a-9015d86ab8f9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112132024-11-09T02:57:31.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cad0f2f5-9d75-4280-bc1a-9015d86ab8f9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112142024-11-09T02:57:32.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81a00499-67e8-4470-9295-6ad2829b3493 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112152024-11-09T02:57:32.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81a00499-67e8-4470-9295-6ad2829b3493 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112162024-11-09T02:57:32.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 81a00499-67e8-4470-9295-6ad2829b3493 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
112172024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
112182024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
112192024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112202024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
112212024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
112222024-11-09T02:57:33.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112232024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112242024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
112252024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112262024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112272024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
112282024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112292024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
112302024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
112312024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112322024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
112332024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
112342024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
112352024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112362024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112372024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
112382024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
112392024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
112402024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
112412024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112422024-11-09T02:57:33.170ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
112432024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
112442024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
112452024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
112462024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112472024-11-09T02:57:33.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
112482024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
112492024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
112502024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
112512024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112522024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112532024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
112542024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
112552024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112562024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
112572024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
112582024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112592024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
112602024-11-09T02:57:33.171ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:47:33.170986598 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
112612024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
112622024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
112632024-11-09T02:57:33.171ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
112642024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.56\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
112652024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
112662024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112672024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
112682024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
112692024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.12\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
112702024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
112712024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.56\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
112722024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.71\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
112732024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
112742024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
112752024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
112762024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.97\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
112772024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
112782024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
112792024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112802024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112812024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112822024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112832024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112842024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112852024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
112862024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112872024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
112882024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112892024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112902024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112912024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112922024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112932024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112942024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112952024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112962024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
112972024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
112982024-11-09T02:57:33.171ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 507731461 } })
112992024-11-09T02:57:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
113002024-11-09T02:57:33.171ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 507750622 } })
113012024-11-09T02:57:33.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
113022024-11-09T02:57:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.41813ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
113032024-11-09T02:57:33.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
113042024-11-09T02:57:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.284537ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
113052024-11-09T02:57:33.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113062024-11-09T02:57:33.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113072024-11-09T02:57:33.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113082024-11-09T02:57:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113092024-11-09T02:57:33.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113102024-11-09T02:57:33.178ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.165388ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113112024-11-09T02:57:33.179ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 515795408 } })
113122024-11-09T02:57:33.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113132024-11-09T02:57:33.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113142024-11-09T02:57:33.179ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
113152024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113162024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
113172024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113182024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113192024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113202024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113212024-11-09T02:57:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113222024-11-09T02:57:33.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113232024-11-09T02:57:33.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113242024-11-09T02:57:33.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113252024-11-09T02:57:33.183ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113262024-11-09T02:57:33.185ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 521681720 } })
113272024-11-09T02:57:33.186ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
113282024-11-09T02:57:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
113292024-11-09T02:57:33.187ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
113302024-11-09T02:57:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113312024-11-09T02:57:33.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113322024-11-09T02:57:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
113332024-11-09T02:57:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113342024-11-09T02:57:33.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113352024-11-09T02:57:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113362024-11-09T02:57:33.191ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113372024-11-09T02:57:33.191ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
113382024-11-09T02:57:33.191ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113392024-11-09T02:57:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113402024-11-09T02:57:33.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113412024-11-09T02:57:33.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113422024-11-09T02:57:33.200ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.266085ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
113432024-11-09T02:57:33.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113442024-11-09T02:57:33.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113452024-11-09T02:57:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113462024-11-09T02:57:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113472024-11-09T02:57:33.206ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:47:33.170986598 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
113482024-11-09T02:57:33.206ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 34.690266ms iteration = 12 status = {"expiration":"2024-11-09T02:47:33.170986598Z","pruned":[]}
113492024-11-09T02:57:33.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113502024-11-09T02:57:33.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113512024-11-09T02:57:33.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113522024-11-09T02:57:33.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113532024-11-09T02:57:33.210ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113542024-11-09T02:57:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113552024-11-09T02:57:33.211ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113562024-11-09T02:57:33.211ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 40.965986ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113572024-11-09T02:57:33.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113582024-11-09T02:57:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113592024-11-09T02:57:33.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113602024-11-09T02:57:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113612024-11-09T02:57:33.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113622024-11-09T02:57:33.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113632024-11-09T02:57:33.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113642024-11-09T02:57:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113652024-11-09T02:57:33.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.78821ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113662024-11-09T02:57:33.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113672024-11-09T02:57:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
113682024-11-09T02:57:33.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113692024-11-09T02:57:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113702024-11-09T02:57:33.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113712024-11-09T02:57:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113722024-11-09T02:57:33.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 586960699 } })
113732024-11-09T02:57:33.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
113742024-11-09T02:57:33.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113752024-11-09T02:57:33.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113762024-11-09T02:57:33.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113772024-11-09T02:57:33.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113782024-11-09T02:57:33.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113792024-11-09T02:57:33.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113802024-11-09T02:57:33.262ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113812024-11-09T02:57:33.262ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113822024-11-09T02:57:33.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113832024-11-09T02:57:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113842024-11-09T02:57:33.263ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113852024-11-09T02:57:33.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113862024-11-09T02:57:33.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113872024-11-09T02:57:33.265ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113882024-11-09T02:57:33.265ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113892024-11-09T02:57:33.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.180516ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113902024-11-09T02:57:33.265ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
113912024-11-09T02:57:33.265ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
113922024-11-09T02:57:33.265ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 94.479623ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
113932024-11-09T02:57:33.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113942024-11-09T02:57:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113952024-11-09T02:57:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
113962024-11-09T02:57:33.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113972024-11-09T02:57:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113982024-11-09T02:57:33.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113992024-11-09T02:57:33.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114002024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114012024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
114022024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114032024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114042024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114052024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
114062024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
114072024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
114082024-11-09T02:57:33.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114092024-11-09T02:57:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114102024-11-09T02:57:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114112024-11-09T02:57:33.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114122024-11-09T02:57:33.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114132024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114142024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
114152024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
114162024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
114172024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114182024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.071724ms iteration = 23 status = 0
114192024-11-09T02:57:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114202024-11-09T02:57:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
114212024-11-09T02:57:33.280ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114222024-11-09T02:57:33.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114232024-11-09T02:57:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114242024-11-09T02:57:33.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114252024-11-09T02:57:33.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114262024-11-09T02:57:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114272024-11-09T02:57:33.284ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
114282024-11-09T02:57:33.284ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
114292024-11-09T02:57:33.284ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.538667ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
114302024-11-09T02:57:33.284ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.991786ms iteration = 26 status = {"physical_disks_added":0}
114312024-11-09T02:57:33.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114322024-11-09T02:57:33.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114332024-11-09T02:57:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114342024-11-09T02:57:33.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114352024-11-09T02:57:33.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114362024-11-09T02:57:33.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114372024-11-09T02:57:33.288ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
114382024-11-09T02:57:33.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114392024-11-09T02:57:33.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
114402024-11-09T02:57:33.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 123.928361ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
114412024-11-09T02:57:33.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114422024-11-09T02:57:33.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114432024-11-09T02:57:33.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114442024-11-09T02:57:33.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
114452024-11-09T02:57:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
114462024-11-09T02:57:33.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 154.247998ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114472024-11-09T02:57:33.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
114482024-11-09T02:57:33.331ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
114492024-11-09T02:57:33.331ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
114502024-11-09T02:57:33.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114512024-11-09T02:57:33.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114522024-11-09T02:57:33.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114532024-11-09T02:57:33.335ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
114542024-11-09T02:57:33.335ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
114552024-11-09T02:57:33.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114562024-11-09T02:57:33.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114572024-11-09T02:57:33.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
114582024-11-09T02:57:33.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114592024-11-09T02:57:33.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114602024-11-09T02:57:33.340ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
114612024-11-09T02:57:33.340ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114622024-11-09T02:57:33.340ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed4f55de-b22d-4c81-afc9-e660e89c34e5", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
114632024-11-09T02:57:33.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114642024-11-09T02:57:33.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114652024-11-09T02:57:33.343ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114662024-11-09T02:57:33.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114672024-11-09T02:57:33.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114682024-11-09T02:57:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114692024-11-09T02:57:33.364ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
114702024-11-09T02:57:33.364ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114712024-11-09T02:57:33.365ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cded3c62-89a0-4328-a492-094382fdb371", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
114722024-11-09T02:57:33.365ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114732024-11-09T02:57:33.367ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114742024-11-09T02:57:33.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114752024-11-09T02:57:33.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114762024-11-09T02:57:33.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114772024-11-09T02:57:33.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114782024-11-09T02:57:33.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114792024-11-09T02:57:33.382ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
114802024-11-09T02:57:33.382ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 211.102632ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
114812024-11-09T02:57:33.384ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
114822024-11-09T02:57:33.384ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
114832024-11-09T02:57:33.384ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
114842024-11-09T02:57:33.384ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 213.9211ms iteration = 12 status = {"generation":2}
114852024-11-09T02:57:33.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114862024-11-09T02:57:33.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114872024-11-09T02:57:33.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114882024-11-09T02:57:33.388ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
114892024-11-09T02:57:33.388ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
114902024-11-09T02:57:33.388ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
114912024-11-09T02:57:33.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 217.923223ms iteration = 12 status = {"generation":1}
114922024-11-09T02:57:33.405ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
114932024-11-09T02:57:33.405ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 234.806422ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
114942024-11-09T02:57:33.408ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
114952024-11-09T02:57:33.408ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114962024-11-09T02:57:33.408ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0a20b74-e9a6-4d34-9384-8f5c5889bd87", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
114972024-11-09T02:57:33.408ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114982024-11-09T02:57:33.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d135e351-07ad-4be9-aa60-f68984b660fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
114992024-11-09T02:57:33.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d135e351-07ad-4be9-aa60-f68984b660fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
115002024-11-09T02:57:33.410ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
115012024-11-09T02:57:33.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d135e351-07ad-4be9-aa60-f68984b660fa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
115022024-11-09T02:57:33.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e0757835-e07e-444d-ab20-533e892e6f07 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
115032024-11-09T02:57:33.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e0757835-e07e-444d-ab20-533e892e6f07 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
115042024-11-09T02:57:33.539ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
115052024-11-09T02:57:33.540ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "71792b03-6bcc-4747-92f3-2427d0503133", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115062024-11-09T02:57:33.540ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115072024-11-09T02:57:33.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c16a43be-ac74-413f-b950-d4b30e500a5f", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115082024-11-09T02:57:33.541ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115092024-11-09T02:57:33.544ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115102024-11-09T02:57:33.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 373.707333ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
115112024-11-09T02:57:33.548ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
115122024-11-09T02:57:33.597ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
115132024-11-09T02:57:33.597ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115142024-11-09T02:57:33.609ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.696346ms iteration = 23 status = {}
115152024-11-09T02:57:33.621ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115162024-11-09T02:57:33.623ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115172024-11-09T02:57:33.623ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbec8cf8-bb04-47cf-bf42-c8e23b19c975", "content-length": "1", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115182024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2537be36-23da-4729-9bd8-f1bb542aa58f", "content-length": "691", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115192024-11-09T02:57:33.623ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
115202024-11-09T02:57:33.623ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
115212024-11-09T02:57:33.623ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115222024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff952e3c-4b57-4bac-a836-47bcd394be52", "content-length": "372", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115232024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115242024-11-09T02:57:33.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e0757835-e07e-444d-ab20-533e892e6f07 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
115252024-11-09T02:57:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115262024-11-09T02:57:33.625ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115272024-11-09T02:57:33.625ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 455.256788ms iteration = 23 status = {}
115282024-11-09T02:57:33.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115292024-11-09T02:57:33.627ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 456.884402ms iteration = 23 status = null
115302024-11-09T02:57:33.653ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
115312024-11-09T02:57:33.653ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ac96cafe-113f-4a59-92ac-8ded1e047701", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115322024-11-09T02:57:33.653ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115332024-11-09T02:57:33.654ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "320f35ba-6ebd-4f9a-9686-094557749cc0", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115342024-11-09T02:57:33.654ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115352024-11-09T02:57:33.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "71d17033-0160-4784-bda9-b73810a63d40", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115362024-11-09T02:57:33.656ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115372024-11-09T02:57:33.658ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
115382024-11-09T02:57:33.658ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 487.310481ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
115392024-11-09T02:57:33.674ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
115402024-11-09T02:57:33.674ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115412024-11-09T02:57:33.674ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "108a64ee-1268-4ba4-b425-bf2d32ddd3bf", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115422024-11-09T02:57:33.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115432024-11-09T02:57:33.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115442024-11-09T02:57:33.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115452024-11-09T02:57:33.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115462024-11-09T02:57:33.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115472024-11-09T02:57:33.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115482024-11-09T02:57:33.685ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115492024-11-09T02:57:33.685ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115502024-11-09T02:57:33.685ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7898257e-f23b-4a87-930b-9c2743950a55", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115512024-11-09T02:57:33.687ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 516.412911ms iteration = 23 status = {}
115522024-11-09T02:57:33.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115532024-11-09T02:57:33.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115542024-11-09T02:57:33.701ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
115552024-11-09T02:57:33.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115562024-11-09T02:57:33.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115572024-11-09T02:57:33.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115582024-11-09T02:57:33.712ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a3cb490-5785-4e8c-9bd7-de5ebc7a9b7d", "content-length": "134", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115592024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115602024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
115612024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115622024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115632024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115642024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115652024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115662024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115672024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115682024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115692024-11-09T02:57:33.712ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
115702024-11-09T02:57:33.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115712024-11-09T02:57:33.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115722024-11-09T02:57:33.714ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115732024-11-09T02:57:33.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e75893a4-7903-4c4e-8fc4-d0649c9fa516", "content-length": "2", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115742024-11-09T02:57:33.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115752024-11-09T02:57:33.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "85099309-4e9e-452f-873e-927d2049dc47", "content-length": "52", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115762024-11-09T02:57:33.715ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
115772024-11-09T02:57:33.715ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115782024-11-09T02:57:33.828ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05a5208e-06c8-4fef-b5ed-73e9eb9c0ed2", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115792024-11-09T02:57:33.828ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
115802024-11-09T02:57:33.828ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115812024-11-09T02:57:33.828ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a262829-5280-4bf7-9a96-7f967290313e", "content-length": "682", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
115822024-11-09T02:57:33.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115832024-11-09T02:57:33.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115842024-11-09T02:57:33.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115852024-11-09T02:57:33.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115862024-11-09T02:57:33.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115872024-11-09T02:57:33.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115882024-11-09T02:57:33.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115892024-11-09T02:57:33.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115902024-11-09T02:57:33.845ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 674.935738ms iteration = 23 status = {}
115912024-11-09T02:57:33.963ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
115922024-11-09T02:57:33.963ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
115932024-11-09T02:57:33.993ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
115942024-11-09T02:57:33.993ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:48815
115952024-11-09T02:57:33.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48815 req_id = bb68605b-67b0-49b8-a3c3-a3b5e607d4b7 roles = RoleSet { roles: {} } uri = /metrics/producers
115962024-11-09T02:57:33.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48815 req_id = bb68605b-67b0-49b8-a3c3-a3b5e607d4b7 resource = Database result = Ok(()) uri = /metrics/producers
115972024-11-09T02:57:34.028ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
115982024-11-09T02:57:34.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34996 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48815 req_id = bb68605b-67b0-49b8-a3c3-a3b5e607d4b7 response_code = 201 uri = /metrics/producers
115992024-11-09T02:57:34.028ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bb68605b-67b0-49b8-a3c3-a3b5e607d4b7", "content-length": "41", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
116002024-11-09T02:57:34.030ZDEBGnexus (producer-registration-task): registered with nexus successfully
116012024-11-09T02:57:34.030ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
116022024-11-09T02:57:34.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f3b7000c-a4dc-4d96-83d2-c15feb91cab9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116032024-11-09T02:57:34.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f3b7000c-a4dc-4d96-83d2-c15feb91cab9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116042024-11-09T02:57:34.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f3b7000c-a4dc-4d96-83d2-c15feb91cab9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116052024-11-09T02:57:35.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4808fd3-f39f-44e1-8ce8-d04f5f13a090 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116062024-11-09T02:57:35.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4808fd3-f39f-44e1-8ce8-d04f5f13a090 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116072024-11-09T02:57:35.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4808fd3-f39f-44e1-8ce8-d04f5f13a090 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116082024-11-09T02:57:36.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b511b84-45bc-49e7-b651-fc98f51073bc roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116092024-11-09T02:57:36.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b511b84-45bc-49e7-b651-fc98f51073bc resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116102024-11-09T02:57:36.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1b511b84-45bc-49e7-b651-fc98f51073bc response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116112024-11-09T02:57:37.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91085bce-258a-48b6-9a0d-df08ca0e8077 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116122024-11-09T02:57:37.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91085bce-258a-48b6-9a0d-df08ca0e8077 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116132024-11-09T02:57:37.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91085bce-258a-48b6-9a0d-df08ca0e8077 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116142024-11-09T02:57:38.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5a721964-3ed8-4844-81dd-ffbe3ea9d4f6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116152024-11-09T02:57:38.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5a721964-3ed8-4844-81dd-ffbe3ea9d4f6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116162024-11-09T02:57:38.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5a721964-3ed8-4844-81dd-ffbe3ea9d4f6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116172024-11-09T02:57:39.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b48e975-34e4-444f-bf4f-11892dffb53d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116182024-11-09T02:57:39.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b48e975-34e4-444f-bf4f-11892dffb53d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116192024-11-09T02:57:39.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b48e975-34e4-444f-bf4f-11892dffb53d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116202024-11-09T02:57:40.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4ebebec-0c08-4ec3-941a-df88b7f5528d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116212024-11-09T02:57:40.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4ebebec-0c08-4ec3-941a-df88b7f5528d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116222024-11-09T02:57:40.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4ebebec-0c08-4ec3-941a-df88b7f5528d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116232024-11-09T02:57:41.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 483ce933-9d96-4428-a866-3c315441e5e5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116242024-11-09T02:57:41.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 483ce933-9d96-4428-a866-3c315441e5e5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116252024-11-09T02:57:41.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 483ce933-9d96-4428-a866-3c315441e5e5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116262024-11-09T02:57:42.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bb46bcda-141e-4fbd-bd5f-ce15b1fe249b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116272024-11-09T02:57:42.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bb46bcda-141e-4fbd-bd5f-ce15b1fe249b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116282024-11-09T02:57:42.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bb46bcda-141e-4fbd-bd5f-ce15b1fe249b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116292024-11-09T02:57:43.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
116302024-11-09T02:57:43.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
116312024-11-09T02:57:43.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116322024-11-09T02:57:43.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116332024-11-09T02:57:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116342024-11-09T02:57:43.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116352024-11-09T02:57:43.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116362024-11-09T02:57:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116372024-11-09T02:57:43.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116382024-11-09T02:57:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116392024-11-09T02:57:43.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116402024-11-09T02:57:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116412024-11-09T02:57:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116422024-11-09T02:57:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
116432024-11-09T02:57:43.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116442024-11-09T02:57:43.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116452024-11-09T02:57:43.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
116462024-11-09T02:57:43.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.415693ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
116472024-11-09T02:57:43.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116482024-11-09T02:57:43.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116492024-11-09T02:57:43.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.881889ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116502024-11-09T02:57:43.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f2be664-46a7-4586-90bd-a1125849c120 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116512024-11-09T02:57:43.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f2be664-46a7-4586-90bd-a1125849c120 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116522024-11-09T02:57:43.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6f2be664-46a7-4586-90bd-a1125849c120 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116532024-11-09T02:57:44.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9adcd843-b532-4ec9-8f6e-84448a5381ce roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116542024-11-09T02:57:44.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9adcd843-b532-4ec9-8f6e-84448a5381ce resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116552024-11-09T02:57:44.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9adcd843-b532-4ec9-8f6e-84448a5381ce response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116562024-11-09T02:57:45.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 556 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 2e563f73-466f-48ac-9d03-53835a0d472b response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
116572024-11-09T02:57:45.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac1d0cfc-a34b-4374-9a2b-51a4f9e846d2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116582024-11-09T02:57:45.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac1d0cfc-a34b-4374-9a2b-51a4f9e846d2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116592024-11-09T02:57:45.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac1d0cfc-a34b-4374-9a2b-51a4f9e846d2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116602024-11-09T02:57:46.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90902cea-c7ba-490a-969a-776c1e443731 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116612024-11-09T02:57:46.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90902cea-c7ba-490a-969a-776c1e443731 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116622024-11-09T02:57:46.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 90902cea-c7ba-490a-969a-776c1e443731 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116632024-11-09T02:57:47.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 355d2916-a15c-49e8-bc68-4b2dba60aaa0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116642024-11-09T02:57:47.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 355d2916-a15c-49e8-bc68-4b2dba60aaa0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116652024-11-09T02:57:47.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 355d2916-a15c-49e8-bc68-4b2dba60aaa0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116662024-11-09T02:57:48.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6ad62d03-b1d1-4845-b245-db124f78543a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116672024-11-09T02:57:48.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6ad62d03-b1d1-4845-b245-db124f78543a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116682024-11-09T02:57:48.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6ad62d03-b1d1-4845-b245-db124f78543a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116692024-11-09T02:57:50.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9524cc59-2332-4bd0-bb84-f3ff5dc9dcfb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116702024-11-09T02:57:50.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9524cc59-2332-4bd0-bb84-f3ff5dc9dcfb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116712024-11-09T02:57:50.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9524cc59-2332-4bd0-bb84-f3ff5dc9dcfb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116722024-11-09T02:57:51.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 47c0528d-da18-44be-b37d-140a04734614 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116732024-11-09T02:57:51.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 47c0528d-da18-44be-b37d-140a04734614 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116742024-11-09T02:57:51.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 47c0528d-da18-44be-b37d-140a04734614 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116752024-11-09T02:57:52.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 736a0386-c808-498c-b5d2-2345209ef874 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116762024-11-09T02:57:52.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 736a0386-c808-498c-b5d2-2345209ef874 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116772024-11-09T02:57:52.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 736a0386-c808-498c-b5d2-2345209ef874 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116782024-11-09T02:57:53.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdc6b460-50db-49aa-8dd7-c58205aa207a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116792024-11-09T02:57:53.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdc6b460-50db-49aa-8dd7-c58205aa207a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116802024-11-09T02:57:53.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cdc6b460-50db-49aa-8dd7-c58205aa207a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
116812024-11-09T02:57:53.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
116822024-11-09T02:57:53.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
116832024-11-09T02:57:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116842024-11-09T02:57:53.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116852024-11-09T02:57:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116862024-11-09T02:57:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116872024-11-09T02:57:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116882024-11-09T02:57:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116892024-11-09T02:57:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116902024-11-09T02:57:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116912024-11-09T02:57:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116922024-11-09T02:57:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116932024-11-09T02:57:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116942024-11-09T02:57:53.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
116952024-11-09T02:57:53.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116962024-11-09T02:57:53.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116972024-11-09T02:57:53.196ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
116982024-11-09T02:57:53.196ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.549498ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
116992024-11-09T02:57:53.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117002024-11-09T02:57:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117012024-11-09T02:57:53.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.423481ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117022024-11-09T02:57:54.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ec9f7da0-0653-46fd-97e7-9666cfd1603e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117032024-11-09T02:57:54.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ec9f7da0-0653-46fd-97e7-9666cfd1603e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117042024-11-09T02:57:54.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ec9f7da0-0653-46fd-97e7-9666cfd1603e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117052024-11-09T02:57:55.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 267345ed-bc53-4e0f-b6a7-f00997a1be31 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117062024-11-09T02:57:55.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 267345ed-bc53-4e0f-b6a7-f00997a1be31 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117072024-11-09T02:57:55.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 267345ed-bc53-4e0f-b6a7-f00997a1be31 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117082024-11-09T02:57:56.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 40651a2b-fe18-43ba-bfa4-923e38bc4502 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117092024-11-09T02:57:56.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 40651a2b-fe18-43ba-bfa4-923e38bc4502 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117102024-11-09T02:57:56.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 40651a2b-fe18-43ba-bfa4-923e38bc4502 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117112024-11-09T02:57:57.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03b415fd-5017-4630-bc0c-b5fc9f43700a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117122024-11-09T02:57:57.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03b415fd-5017-4630-bc0c-b5fc9f43700a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117132024-11-09T02:57:57.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03b415fd-5017-4630-bc0c-b5fc9f43700a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117142024-11-09T02:57:58.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b945f6c7-839d-4b90-adb5-7c0bfd1a2e58 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117152024-11-09T02:57:58.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b945f6c7-839d-4b90-adb5-7c0bfd1a2e58 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117162024-11-09T02:57:58.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b945f6c7-839d-4b90-adb5-7c0bfd1a2e58 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117172024-11-09T02:57:59.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4b5c123-93ce-4699-b5c6-301aef22f511 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117182024-11-09T02:57:59.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4b5c123-93ce-4699-b5c6-301aef22f511 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117192024-11-09T02:57:59.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f4b5c123-93ce-4699-b5c6-301aef22f511 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117202024-11-09T02:58:00.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 672 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 19a7ed1b-d6d8-445d-bbcd-67539fdee11f response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
117212024-11-09T02:58:00.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 674ed371-5882-4b2b-85fe-1936af3852f6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117222024-11-09T02:58:00.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 674ed371-5882-4b2b-85fe-1936af3852f6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117232024-11-09T02:58:00.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 674ed371-5882-4b2b-85fe-1936af3852f6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117242024-11-09T02:58:01.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 08aba25a-ff91-45ba-a1d1-49c025b8b153 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117252024-11-09T02:58:01.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 08aba25a-ff91-45ba-a1d1-49c025b8b153 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117262024-11-09T02:58:01.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 08aba25a-ff91-45ba-a1d1-49c025b8b153 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117272024-11-09T02:58:02.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ad3917b8-1294-4e43-9ae3-42083f3b89e9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117282024-11-09T02:58:02.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ad3917b8-1294-4e43-9ae3-42083f3b89e9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117292024-11-09T02:58:02.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ad3917b8-1294-4e43-9ae3-42083f3b89e9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
117302024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
117312024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117322024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
117332024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
117342024-11-09T02:58:03.170ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117352024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117362024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
117372024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117382024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117392024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
117402024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117412024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
117422024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
117432024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117442024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
117452024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117462024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117472024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
117482024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
117492024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117502024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
117512024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
117522024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117532024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
117542024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117552024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117562024-11-09T02:58:03.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117572024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117582024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117592024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117602024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117612024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117622024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117632024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117642024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117652024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117662024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117672024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117682024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117692024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
117702024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
117712024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.13\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
117722024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.57\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
117732024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
117742024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
117752024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.37\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
117762024-11-09T02:58:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.09\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
117772024-11-09T02:58:03.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117782024-11-09T02:58:03.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117792024-11-09T02:58:03.173ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 509680462 } })
117802024-11-09T02:58:03.174ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
117812024-11-09T02:58:03.174ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.255188ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117822024-11-09T02:58:03.175ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 510908947 } })
117832024-11-09T02:58:03.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117842024-11-09T02:58:03.175ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
117852024-11-09T02:58:03.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117862024-11-09T02:58:03.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117872024-11-09T02:58:03.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117882024-11-09T02:58:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117892024-11-09T02:58:03.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117902024-11-09T02:58:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117912024-11-09T02:58:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117922024-11-09T02:58:03.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117932024-11-09T02:58:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117942024-11-09T02:58:03.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117952024-11-09T02:58:03.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117962024-11-09T02:58:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117972024-11-09T02:58:03.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117982024-11-09T02:58:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117992024-11-09T02:58:03.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118002024-11-09T02:58:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118012024-11-09T02:58:03.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118022024-11-09T02:58:03.181ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118032024-11-09T02:58:03.181ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118042024-11-09T02:58:03.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118052024-11-09T02:58:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118062024-11-09T02:58:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118072024-11-09T02:58:03.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118082024-11-09T02:58:03.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118092024-11-09T02:58:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118102024-11-09T02:58:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118112024-11-09T02:58:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118122024-11-09T02:58:03.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118132024-11-09T02:58:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118142024-11-09T02:58:03.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118152024-11-09T02:58:03.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118162024-11-09T02:58:03.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118172024-11-09T02:58:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118182024-11-09T02:58:03.189ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118192024-11-09T02:58:03.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118202024-11-09T02:58:03.189ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118212024-11-09T02:58:03.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118222024-11-09T02:58:03.189ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 525855436 } })
118232024-11-09T02:58:03.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118242024-11-09T02:58:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118252024-11-09T02:58:03.190ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
118262024-11-09T02:58:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118272024-11-09T02:58:03.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118282024-11-09T02:58:03.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118292024-11-09T02:58:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118302024-11-09T02:58:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
118312024-11-09T02:58:03.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118322024-11-09T02:58:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118332024-11-09T02:58:03.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118342024-11-09T02:58:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118352024-11-09T02:58:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118362024-11-09T02:58:03.207ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
118372024-11-09T02:58:03.207ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.204249ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
118382024-11-09T02:58:03.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.920817ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118392024-11-09T02:58:03.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118402024-11-09T02:58:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118412024-11-09T02:58:03.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118422024-11-09T02:58:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118432024-11-09T02:58:03.223ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118442024-11-09T02:58:03.223ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.77204ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118452024-11-09T02:58:03.228ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118462024-11-09T02:58:03.228ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118472024-11-09T02:58:03.228ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.625971ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118482024-11-09T02:58:03.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
118492024-11-09T02:58:03.267ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118502024-11-09T02:58:03.268ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee7665b5-d0a3-455a-8d15-bf4ad85b1cbf", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
118512024-11-09T02:58:03.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118522024-11-09T02:58:03.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118532024-11-09T02:58:03.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
118542024-11-09T02:58:03.275ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118552024-11-09T02:58:03.275ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec5434aa-04c6-4e4f-9811-509ae6009719", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
118562024-11-09T02:58:03.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118572024-11-09T02:58:03.277ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118582024-11-09T02:58:03.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118592024-11-09T02:58:03.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118602024-11-09T02:58:03.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
118612024-11-09T02:58:03.290ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118622024-11-09T02:58:03.290ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac1de92b-a4b0-4b41-a1a4-e84bb9f12501", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
118632024-11-09T02:58:03.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118642024-11-09T02:58:03.292ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
118652024-11-09T02:58:03.316ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118662024-11-09T02:58:03.316ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118672024-11-09T02:58:03.316ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf9aeae-cec8-4b4a-a768-a94ac262c40d", "content-length": "372", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
118682024-11-09T02:58:03.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118692024-11-09T02:58:03.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118702024-11-09T02:58:03.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41e78514-6316-480d-9247-355869a08bb4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
118712024-11-09T02:58:03.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41e78514-6316-480d-9247-355869a08bb4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
118722024-11-09T02:58:03.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 148.038219ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118732024-11-09T02:58:03.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118742024-11-09T02:58:03.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118752024-11-09T02:58:03.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 41e78514-6316-480d-9247-355869a08bb4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
118762024-11-09T02:58:03.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118772024-11-09T02:58:03.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
118782024-11-09T02:58:03.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118792024-11-09T02:58:03.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118802024-11-09T02:58:03.326ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 156.075545ms iteration = 24 status = 0
118812024-11-09T02:58:03.332ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118822024-11-09T02:58:03.332ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118832024-11-09T02:58:03.333ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9ac5542e-c5e1-42e0-8aa1-71b0662468ea", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
118842024-11-09T02:58:03.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118852024-11-09T02:58:03.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118862024-11-09T02:58:03.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118872024-11-09T02:58:03.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118882024-11-09T02:58:03.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118892024-11-09T02:58:03.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118902024-11-09T02:58:03.341ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118912024-11-09T02:58:03.341ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118922024-11-09T02:58:03.384ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
118932024-11-09T02:58:03.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118942024-11-09T02:58:03.384ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "49caf86d-0676-4921-b8ad-30dcd1065afe", "content-length": "1", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
118952024-11-09T02:58:03.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118962024-11-09T02:58:03.385ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118972024-11-09T02:58:03.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118982024-11-09T02:58:03.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118992024-11-09T02:58:03.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119002024-11-09T02:58:03.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119012024-11-09T02:58:03.388ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.572715ms iteration = 24 status = null
119022024-11-09T02:58:03.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119032024-11-09T02:58:03.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119042024-11-09T02:58:03.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119052024-11-09T02:58:03.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119062024-11-09T02:58:03.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119072024-11-09T02:58:03.394ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.08696ms iteration = 24 status = {}
119082024-11-09T02:58:03.422ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 251.774093ms iteration = 27 status = {"physical_disks_added":0}
119092024-11-09T02:58:03.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d76d7664-dd4b-4475-9b01-06426c0691b6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
119102024-11-09T02:58:03.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d76d7664-dd4b-4475-9b01-06426c0691b6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
119112024-11-09T02:58:03.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = d76d7664-dd4b-4475-9b01-06426c0691b6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
119122024-11-09T02:58:03.453ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119132024-11-09T02:58:03.459ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1571c483-f229-4243-b009-3e080e0619e3", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119142024-11-09T02:58:03.461ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.84975ms iteration = 24 status = {}
119152024-11-09T02:58:03.461ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1d44d41-3b9f-4314-91b3-196ba1b0bd2e", "content-length": "691", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119162024-11-09T02:58:03.461ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119172024-11-09T02:58:03.461ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119182024-11-09T02:58:03.461ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119192024-11-09T02:58:03.462ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.078406ms iteration = 24 status = {}
119202024-11-09T02:58:03.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119212024-11-09T02:58:03.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119222024-11-09T02:58:03.487ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
119232024-11-09T02:58:03.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119242024-11-09T02:58:03.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119252024-11-09T02:58:03.496ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119262024-11-09T02:58:03.496ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e8f0d79-d8ec-4bfb-80a6-08a62fefe883", "content-length": "134", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119272024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119282024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
119292024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119302024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119312024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119322024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119332024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119342024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119352024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119362024-11-09T02:58:03.496ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119372024-11-09T02:58:03.497ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
119382024-11-09T02:58:03.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119392024-11-09T02:58:03.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119402024-11-09T02:58:03.499ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119412024-11-09T02:58:03.499ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a40d261d-011b-4ffe-8270-e61ef154c070", "content-length": "2", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119422024-11-09T02:58:03.499ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119432024-11-09T02:58:03.499ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "724a5ac2-38b6-4b81-933f-11c29fe53c95", "content-length": "52", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119442024-11-09T02:58:03.499ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
119452024-11-09T02:58:03.499ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119462024-11-09T02:58:03.698ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cec39677-80f3-4678-a9f9-9ea2b6a2eaa0", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119472024-11-09T02:58:03.698ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
119482024-11-09T02:58:03.698ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119492024-11-09T02:58:03.699ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d58fb01-ffc4-4c9e-b38b-6625eba6ee17", "content-length": "682", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
119502024-11-09T02:58:03.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119512024-11-09T02:58:03.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119522024-11-09T02:58:03.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119532024-11-09T02:58:03.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119542024-11-09T02:58:03.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119552024-11-09T02:58:03.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119562024-11-09T02:58:03.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119572024-11-09T02:58:03.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119582024-11-09T02:58:03.716ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.939532ms iteration = 24 status = {}
119592024-11-09T02:58:04.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 48cce4ef-4ee7-4913-92af-15e2b6c066e8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119602024-11-09T02:58:04.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 48cce4ef-4ee7-4913-92af-15e2b6c066e8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119612024-11-09T02:58:04.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 48cce4ef-4ee7-4913-92af-15e2b6c066e8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119622024-11-09T02:58:05.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43cfd3bb-2809-41c8-a12e-ed71d3b627c5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119632024-11-09T02:58:05.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43cfd3bb-2809-41c8-a12e-ed71d3b627c5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119642024-11-09T02:58:05.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43cfd3bb-2809-41c8-a12e-ed71d3b627c5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119652024-11-09T02:58:06.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e9d2140d-d598-498d-9741-6d207b864a0a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119662024-11-09T02:58:06.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e9d2140d-d598-498d-9741-6d207b864a0a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119672024-11-09T02:58:06.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e9d2140d-d598-498d-9741-6d207b864a0a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119682024-11-09T02:58:07.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c89e6fab-806d-47c5-969c-a89a6d52e4d1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119692024-11-09T02:58:07.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c89e6fab-806d-47c5-969c-a89a6d52e4d1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119702024-11-09T02:58:07.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c89e6fab-806d-47c5-969c-a89a6d52e4d1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119712024-11-09T02:58:08.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e2871e3-c448-4992-9479-b3fc573cfd45 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119722024-11-09T02:58:08.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e2871e3-c448-4992-9479-b3fc573cfd45 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119732024-11-09T02:58:08.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e2871e3-c448-4992-9479-b3fc573cfd45 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119742024-11-09T02:58:09.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa9e910a-4aca-44c0-974a-c2608e9fa88a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119752024-11-09T02:58:09.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa9e910a-4aca-44c0-974a-c2608e9fa88a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119762024-11-09T02:58:09.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = aa9e910a-4aca-44c0-974a-c2608e9fa88a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119772024-11-09T02:58:10.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9d89ff8-98c1-4254-a041-81bc70696159 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119782024-11-09T02:58:10.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9d89ff8-98c1-4254-a041-81bc70696159 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119792024-11-09T02:58:10.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9d89ff8-98c1-4254-a041-81bc70696159 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119802024-11-09T02:58:11.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e3a31e27-bb02-4e81-b3a8-8265505b9ed0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119812024-11-09T02:58:11.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e3a31e27-bb02-4e81-b3a8-8265505b9ed0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119822024-11-09T02:58:11.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e3a31e27-bb02-4e81-b3a8-8265505b9ed0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119832024-11-09T02:58:12.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01947f2b-1eae-40cb-bfd0-9c3d17797b8c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119842024-11-09T02:58:12.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01947f2b-1eae-40cb-bfd0-9c3d17797b8c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119852024-11-09T02:58:12.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01947f2b-1eae-40cb-bfd0-9c3d17797b8c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
119862024-11-09T02:58:13.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
119872024-11-09T02:58:13.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
119882024-11-09T02:58:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119892024-11-09T02:58:13.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119902024-11-09T02:58:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119912024-11-09T02:58:13.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119922024-11-09T02:58:13.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119932024-11-09T02:58:13.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119942024-11-09T02:58:13.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119952024-11-09T02:58:13.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.194437ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119962024-11-09T02:58:13.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119972024-11-09T02:58:13.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119982024-11-09T02:58:13.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119992024-11-09T02:58:13.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120002024-11-09T02:58:13.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120012024-11-09T02:58:13.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120022024-11-09T02:58:13.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
120032024-11-09T02:58:13.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120042024-11-09T02:58:13.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120052024-11-09T02:58:13.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
120062024-11-09T02:58:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.82965ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
120072024-11-09T02:58:13.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e92a468f-6a25-4fc7-9b07-28e63c9327bf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120082024-11-09T02:58:13.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e92a468f-6a25-4fc7-9b07-28e63c9327bf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120092024-11-09T02:58:13.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e92a468f-6a25-4fc7-9b07-28e63c9327bf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120102024-11-09T02:58:14.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9f3448f8-2aee-4e51-8509-f9d6284eb943 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120112024-11-09T02:58:14.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9f3448f8-2aee-4e51-8509-f9d6284eb943 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120122024-11-09T02:58:14.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9f3448f8-2aee-4e51-8509-f9d6284eb943 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120132024-11-09T02:58:15.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 739 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = c8756e93-b40b-4902-a7b4-f326880f5b45 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
120142024-11-09T02:58:15.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c310c65c-06a5-4e1c-9801-a88bb68e88d4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120152024-11-09T02:58:15.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c310c65c-06a5-4e1c-9801-a88bb68e88d4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120162024-11-09T02:58:15.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c310c65c-06a5-4e1c-9801-a88bb68e88d4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120172024-11-09T02:58:16.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 361484ab-85a7-4f1f-ad75-0d02826280bd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120182024-11-09T02:58:16.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 361484ab-85a7-4f1f-ad75-0d02826280bd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120192024-11-09T02:58:16.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 361484ab-85a7-4f1f-ad75-0d02826280bd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120202024-11-09T02:58:17.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 549acad3-4541-43ac-a52a-2d0ebb81748c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120212024-11-09T02:58:17.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 549acad3-4541-43ac-a52a-2d0ebb81748c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120222024-11-09T02:58:17.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 549acad3-4541-43ac-a52a-2d0ebb81748c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120232024-11-09T02:58:18.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60a71787-087f-4de6-98dd-8dbe8327b5e5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120242024-11-09T02:58:18.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60a71787-087f-4de6-98dd-8dbe8327b5e5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120252024-11-09T02:58:18.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60a71787-087f-4de6-98dd-8dbe8327b5e5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120262024-11-09T02:58:19.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91809b04-0da1-45a2-b335-ae1835d415d7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120272024-11-09T02:58:19.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91809b04-0da1-45a2-b335-ae1835d415d7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120282024-11-09T02:58:19.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91809b04-0da1-45a2-b335-ae1835d415d7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120292024-11-09T02:58:20.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 30fb28f2-5606-4395-8e71-bd4f6fd043ca roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
120302024-11-09T02:58:20.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 30fb28f2-5606-4395-8e71-bd4f6fd043ca resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
120312024-11-09T02:58:20.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 30fb28f2-5606-4395-8e71-bd4f6fd043ca response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
120322024-11-09T02:58:20.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = bc026534-b263-4bad-8525-ce5afc488f8f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
120332024-11-09T02:58:20.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = bc026534-b263-4bad-8525-ce5afc488f8f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
120342024-11-09T02:58:20.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = bc026534-b263-4bad-8525-ce5afc488f8f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
120352024-11-09T02:58:20.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4499ebd5-2fd4-48f4-80a2-7a36b79f94ef roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120362024-11-09T02:58:20.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4499ebd5-2fd4-48f4-80a2-7a36b79f94ef resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120372024-11-09T02:58:20.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4499ebd5-2fd4-48f4-80a2-7a36b79f94ef response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120382024-11-09T02:58:21.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 758e6138-1f44-4a6e-9cdf-7fc10108582c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120392024-11-09T02:58:21.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 758e6138-1f44-4a6e-9cdf-7fc10108582c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120402024-11-09T02:58:21.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 758e6138-1f44-4a6e-9cdf-7fc10108582c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120412024-11-09T02:58:22.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 21d37039-a9c6-4917-bfa1-d778dc64e8b3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120422024-11-09T02:58:22.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 21d37039-a9c6-4917-bfa1-d778dc64e8b3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120432024-11-09T02:58:22.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 21d37039-a9c6-4917-bfa1-d778dc64e8b3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120442024-11-09T02:58:23.170ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
120452024-11-09T02:58:23.170ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
120462024-11-09T02:58:23.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120472024-11-09T02:58:23.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120482024-11-09T02:58:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120492024-11-09T02:58:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120502024-11-09T02:58:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120512024-11-09T02:58:23.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120522024-11-09T02:58:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120532024-11-09T02:58:23.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.149496ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120542024-11-09T02:58:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120552024-11-09T02:58:23.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120562024-11-09T02:58:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120572024-11-09T02:58:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120582024-11-09T02:58:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120592024-11-09T02:58:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120602024-11-09T02:58:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
120612024-11-09T02:58:23.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120622024-11-09T02:58:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120632024-11-09T02:58:23.195ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
120642024-11-09T02:58:23.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.064918ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
120652024-11-09T02:58:23.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9dd64fb0-9878-4e06-a144-bd014b86c804 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120662024-11-09T02:58:23.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9dd64fb0-9878-4e06-a144-bd014b86c804 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120672024-11-09T02:58:23.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9dd64fb0-9878-4e06-a144-bd014b86c804 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120682024-11-09T02:58:24.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82b62796-e4c4-475f-b058-41b8d4f1634f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120692024-11-09T02:58:24.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82b62796-e4c4-475f-b058-41b8d4f1634f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120702024-11-09T02:58:24.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82b62796-e4c4-475f-b058-41b8d4f1634f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120712024-11-09T02:58:25.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f04fdef5-0ed2-46f6-b4d0-59f1e14bcfd9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120722024-11-09T02:58:25.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f04fdef5-0ed2-46f6-b4d0-59f1e14bcfd9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120732024-11-09T02:58:25.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f04fdef5-0ed2-46f6-b4d0-59f1e14bcfd9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120742024-11-09T02:58:26.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2b378fe-0db7-4615-be85-1d9678185803 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120752024-11-09T02:58:26.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2b378fe-0db7-4615-be85-1d9678185803 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120762024-11-09T02:58:26.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2b378fe-0db7-4615-be85-1d9678185803 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120772024-11-09T02:58:28.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e02ecac0-41e1-4a77-9852-d2eefa75386a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120782024-11-09T02:58:28.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e02ecac0-41e1-4a77-9852-d2eefa75386a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120792024-11-09T02:58:28.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e02ecac0-41e1-4a77-9852-d2eefa75386a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120802024-11-09T02:58:29.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 85ec3c37-1eef-4657-af4b-a1fb54e2d78f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120812024-11-09T02:58:29.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 85ec3c37-1eef-4657-af4b-a1fb54e2d78f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120822024-11-09T02:58:29.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 85ec3c37-1eef-4657-af4b-a1fb54e2d78f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120832024-11-09T02:58:30.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d466e01-f8df-4e70-a59d-2db8c35f1f83 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120842024-11-09T02:58:30.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d466e01-f8df-4e70-a59d-2db8c35f1f83 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120852024-11-09T02:58:30.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d466e01-f8df-4e70-a59d-2db8c35f1f83 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120862024-11-09T02:58:30.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 517 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 5bfe072b-95a8-4799-95ab-e9378df9891c response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
120872024-11-09T02:58:31.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6558c7bc-8abb-4cbd-960d-ffd8abbf5c0d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120882024-11-09T02:58:31.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6558c7bc-8abb-4cbd-960d-ffd8abbf5c0d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120892024-11-09T02:58:31.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6558c7bc-8abb-4cbd-960d-ffd8abbf5c0d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120902024-11-09T02:58:31.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a98877b1-911d-4d28-8096-a05447892e39 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
120912024-11-09T02:58:31.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a98877b1-911d-4d28-8096-a05447892e39 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
120922024-11-09T02:58:31.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a98877b1-911d-4d28-8096-a05447892e39 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
120932024-11-09T02:58:31.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 41b8351d-0750-4b7d-94b1-9c6845ff95c5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
120942024-11-09T02:58:31.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 41b8351d-0750-4b7d-94b1-9c6845ff95c5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
120952024-11-09T02:58:31.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 41b8351d-0750-4b7d-94b1-9c6845ff95c5 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
120962024-11-09T02:58:32.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ab8dc19-afc1-4368-97ec-980bbeb63e12 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120972024-11-09T02:58:32.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ab8dc19-afc1-4368-97ec-980bbeb63e12 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120982024-11-09T02:58:32.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ab8dc19-afc1-4368-97ec-980bbeb63e12 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
120992024-11-09T02:58:33.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 52d99a2e-9837-46d9-b2ca-2af8a2aa54c5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
121002024-11-09T02:58:33.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 52d99a2e-9837-46d9-b2ca-2af8a2aa54c5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
121012024-11-09T02:58:33.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 52d99a2e-9837-46d9-b2ca-2af8a2aa54c5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
121022024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
121032024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
121042024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121052024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
121062024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
121072024-11-09T02:58:33.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121082024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
121092024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121102024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121112024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121122024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
121132024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
121142024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
121152024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
121162024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121172024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
121182024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
121192024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
121202024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
121212024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121222024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
121232024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
121242024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121252024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121262024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
121272024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
121282024-11-09T02:58:33.171ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
121292024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
121302024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121312024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.36\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
121322024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
121332024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.341\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
121342024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
121352024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121362024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
121372024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
121382024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
121392024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.04\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
121402024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.34\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
121412024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
121422024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
121432024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
121442024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.22\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
121452024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121462024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
121472024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
121482024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
121492024-11-09T02:58:33.171ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:48:33.171684773 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
121502024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121512024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
121522024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
121532024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
121542024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121552024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
121562024-11-09T02:58:33.171ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
121572024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121582024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
121592024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
121602024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121612024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
121622024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
121632024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121642024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121652024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121662024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121672024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121682024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
121692024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121702024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121712024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121722024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121732024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121742024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121752024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
121762024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
121772024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121782024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121792024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121802024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121812024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
121822024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121832024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121842024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121852024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121862024-11-09T02:58:33.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 508019397 } })
121872024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121882024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121892024-11-09T02:58:33.172ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 508182901 } })
121902024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121912024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121922024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121932024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121942024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
121952024-11-09T02:58:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.401519ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
121962024-11-09T02:58:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121972024-11-09T02:58:33.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121982024-11-09T02:58:33.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
121992024-11-09T02:58:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.4594ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
122002024-11-09T02:58:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122012024-11-09T02:58:33.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122022024-11-09T02:58:33.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.554304ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122032024-11-09T02:58:33.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122042024-11-09T02:58:33.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122052024-11-09T02:58:33.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122062024-11-09T02:58:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122072024-11-09T02:58:33.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122082024-11-09T02:58:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122092024-11-09T02:58:33.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122102024-11-09T02:58:33.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122112024-11-09T02:58:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122122024-11-09T02:58:33.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122132024-11-09T02:58:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122142024-11-09T02:58:33.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122152024-11-09T02:58:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122162024-11-09T02:58:33.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 517828130 } })
122172024-11-09T02:58:33.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
122182024-11-09T02:58:33.183ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.488627ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
122192024-11-09T02:58:33.184ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:48:33.171684773 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
122202024-11-09T02:58:33.184ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.869536ms iteration = 13 status = {"expiration":"2024-11-09T02:48:33.171684773Z","pruned":[]}
122212024-11-09T02:58:33.184ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122222024-11-09T02:58:33.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 521941045 } })
122232024-11-09T02:58:33.186ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
122242024-11-09T02:58:33.187ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122252024-11-09T02:58:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
122262024-11-09T02:58:33.187ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122272024-11-09T02:58:33.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122282024-11-09T02:58:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122292024-11-09T02:58:33.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122302024-11-09T02:58:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
122312024-11-09T02:58:33.191ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
122322024-11-09T02:58:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
122332024-11-09T02:58:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122342024-11-09T02:58:33.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122352024-11-09T02:58:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122362024-11-09T02:58:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122372024-11-09T02:58:33.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122382024-11-09T02:58:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122392024-11-09T02:58:33.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122402024-11-09T02:58:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122412024-11-09T02:58:33.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122422024-11-09T02:58:33.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122432024-11-09T02:58:33.196ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122442024-11-09T02:58:33.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122452024-11-09T02:58:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122462024-11-09T02:58:33.198ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122472024-11-09T02:58:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122482024-11-09T02:58:33.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
122492024-11-09T02:58:33.199ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122502024-11-09T02:58:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122512024-11-09T02:58:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122522024-11-09T02:58:33.200ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122532024-11-09T02:58:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
122542024-11-09T02:58:33.200ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122552024-11-09T02:58:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122562024-11-09T02:58:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122572024-11-09T02:58:33.201ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122582024-11-09T02:58:33.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122592024-11-09T02:58:33.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122602024-11-09T02:58:33.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
122612024-11-09T02:58:33.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122622024-11-09T02:58:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122632024-11-09T02:58:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122642024-11-09T02:58:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122652024-11-09T02:58:33.213ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 549572326 } })
122662024-11-09T02:58:33.214ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
122672024-11-09T02:58:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122682024-11-09T02:58:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122692024-11-09T02:58:33.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122702024-11-09T02:58:33.220ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
122712024-11-09T02:58:33.220ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
122722024-11-09T02:58:33.220ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 48.271017ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
122732024-11-09T02:58:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122742024-11-09T02:58:33.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122752024-11-09T02:58:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122762024-11-09T02:58:33.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122772024-11-09T02:58:33.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122782024-11-09T02:58:33.225ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122792024-11-09T02:58:33.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122802024-11-09T02:58:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122812024-11-09T02:58:33.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122822024-11-09T02:58:33.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122832024-11-09T02:58:33.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122842024-11-09T02:58:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
122852024-11-09T02:58:33.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122862024-11-09T02:58:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
122872024-11-09T02:58:33.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122882024-11-09T02:58:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122892024-11-09T02:58:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122902024-11-09T02:58:33.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122912024-11-09T02:58:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122922024-11-09T02:58:33.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122932024-11-09T02:58:33.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122942024-11-09T02:58:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122952024-11-09T02:58:33.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122962024-11-09T02:58:33.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122972024-11-09T02:58:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122982024-11-09T02:58:33.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122992024-11-09T02:58:33.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
123002024-11-09T02:58:33.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.700076ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
123012024-11-09T02:58:33.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123022024-11-09T02:58:33.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123032024-11-09T02:58:33.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123042024-11-09T02:58:33.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123052024-11-09T02:58:33.254ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123062024-11-09T02:58:33.254ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123072024-11-09T02:58:33.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123082024-11-09T02:58:33.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123092024-11-09T02:58:33.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
123102024-11-09T02:58:33.255ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
123112024-11-09T02:58:33.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
123122024-11-09T02:58:33.255ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
123132024-11-09T02:58:33.255ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
123142024-11-09T02:58:33.255ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.088837ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
123152024-11-09T02:58:33.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123162024-11-09T02:58:33.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123172024-11-09T02:58:33.259ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123182024-11-09T02:58:33.259ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123192024-11-09T02:58:33.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123202024-11-09T02:58:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123212024-11-09T02:58:33.260ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
123222024-11-09T02:58:33.260ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
123232024-11-09T02:58:33.260ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
123242024-11-09T02:58:33.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123252024-11-09T02:58:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123262024-11-09T02:58:33.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123272024-11-09T02:58:33.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123282024-11-09T02:58:33.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123292024-11-09T02:58:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123302024-11-09T02:58:33.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123312024-11-09T02:58:33.266ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
123322024-11-09T02:58:33.266ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
123332024-11-09T02:58:33.266ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
123342024-11-09T02:58:33.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123352024-11-09T02:58:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123362024-11-09T02:58:33.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.456164ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123372024-11-09T02:58:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
123382024-11-09T02:58:33.269ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
123392024-11-09T02:58:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
123402024-11-09T02:58:33.284ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123412024-11-09T02:58:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123422024-11-09T02:58:33.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
123432024-11-09T02:58:33.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
123442024-11-09T02:58:33.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 120.560912ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123452024-11-09T02:58:33.356ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
123462024-11-09T02:58:33.356ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123472024-11-09T02:58:33.356ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
123482024-11-09T02:58:33.356ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27527286-6121-429d-9ced-72a17a3171d1", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:32 GMT"} })
123492024-11-09T02:58:33.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123502024-11-09T02:58:33.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123512024-11-09T02:58:33.388ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 216.703547ms iteration = 28 status = {"physical_disks_added":0}
123522024-11-09T02:58:33.400ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
123532024-11-09T02:58:33.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
123542024-11-09T02:58:33.403ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123552024-11-09T02:58:33.403ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77e032c7-afd9-4529-a02a-7281a2a32a8f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
123562024-11-09T02:58:33.403ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123572024-11-09T02:58:33.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123582024-11-09T02:58:33.427ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123592024-11-09T02:58:33.428ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77694e02-9706-44cc-887c-39e6c3898c34", "content-length": "810", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
123602024-11-09T02:58:33.428ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1603470) }} sled = buskin
123612024-11-09T02:58:33.428ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
123622024-11-09T02:58:33.428ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
123632024-11-09T02:58:33.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123642024-11-09T02:58:33.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123652024-11-09T02:58:33.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.217557ms iteration = 25 status = {}
123662024-11-09T02:58:33.519ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/cb313128-bef6-4891-a142-8c709c04545b/state
123672024-11-09T02:58:33.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123682024-11-09T02:58:33.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123692024-11-09T02:58:33.524ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 353.264781ms iteration = 6 status = {"nsuccess":5}
123702024-11-09T02:58:33.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123712024-11-09T02:58:33.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123722024-11-09T02:58:33.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123732024-11-09T02:58:33.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123742024-11-09T02:58:33.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123752024-11-09T02:58:33.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123762024-11-09T02:58:33.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
123772024-11-09T02:58:33.540ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123782024-11-09T02:58:33.541ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f78ea286-9cfe-4445-9ac1-3d833e62dc29", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
123792024-11-09T02:58:33.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123802024-11-09T02:58:33.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
123812024-11-09T02:58:33.547ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
123822024-11-09T02:58:33.547ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "454ca2fb-1e97-46da-adcd-c9bffdd5ee9b", "content-length": "1", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
123832024-11-09T02:58:33.549ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123842024-11-09T02:58:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123852024-11-09T02:58:33.552ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 380.420082ms iteration = 25 status = null
123862024-11-09T02:58:33.561ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123872024-11-09T02:58:33.561ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
123882024-11-09T02:58:33.561ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123892024-11-09T02:58:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 389.297205ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123902024-11-09T02:58:33.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123912024-11-09T02:58:33.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123922024-11-09T02:58:33.570ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 398.923114ms iteration = 25 status = {}
123932024-11-09T02:58:33.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
123942024-11-09T02:58:33.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123952024-11-09T02:58:33.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123962024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
123972024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
123982024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123992024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
124002024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124012024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
124022024-11-09T02:58:33.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124032024-11-09T02:58:33.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124042024-11-09T02:58:33.574ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 402.753043ms iteration = 25 status = 0
124052024-11-09T02:58:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
124062024-11-09T02:58:33.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
124072024-11-09T02:58:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
124082024-11-09T02:58:33.578ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
124092024-11-09T02:58:33.578ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
124102024-11-09T02:58:33.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124112024-11-09T02:58:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124122024-11-09T02:58:33.579ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
124132024-11-09T02:58:33.579ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
124142024-11-09T02:58:33.579ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
124152024-11-09T02:58:33.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 407.822948ms iteration = 13 status = {"generation":2}
124162024-11-09T02:58:33.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124172024-11-09T02:58:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
124182024-11-09T02:58:33.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124192024-11-09T02:58:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124202024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
124212024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
124222024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
124232024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 414.324132ms iteration = 13 status = {"generation":1}
124242024-11-09T02:58:33.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
124252024-11-09T02:58:33.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bc3538cb-2c29-4cee-ae3a-21ac3d504126", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124262024-11-09T02:58:33.587ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124272024-11-09T02:58:33.589ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "abb4f1a5-4731-46ed-949d-7fdcb1047b76", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124282024-11-09T02:58:33.589ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124292024-11-09T02:58:33.592ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124302024-11-09T02:58:33.592ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 420.729575ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
124312024-11-09T02:58:33.607ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
124322024-11-09T02:58:33.607ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 435.574382ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
124332024-11-09T02:58:33.643ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
124342024-11-09T02:58:33.644ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "95395006-299b-45e7-a108-05eb1d0a6632", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124352024-11-09T02:58:33.644ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124362024-11-09T02:58:33.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "12cabd66-e1c3-4df7-850e-061aab55b4a9", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124372024-11-09T02:58:33.646ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124382024-11-09T02:58:33.647ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6bd06f6d-0e3e-4770-9aff-d507e1ecb0a1", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124392024-11-09T02:58:33.648ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124402024-11-09T02:58:33.650ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124412024-11-09T02:58:33.650ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 478.798015ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
124422024-11-09T02:58:33.653ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
124432024-11-09T02:58:33.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 481.532031ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
124442024-11-09T02:58:33.659ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
124452024-11-09T02:58:33.659ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124462024-11-09T02:58:33.660ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfa04d3f-2621-4400-8d7e-74e8325d4fa7", "content-length": "583", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124472024-11-09T02:58:33.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124482024-11-09T02:58:33.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124492024-11-09T02:58:33.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {2945403d-7dac-4915-b39b-33737fbebf32: {10.151.1.175: {0df7e5b9-3539-48e3-9b34-00c5061bdee6}, 10.151.1.176: {0df7e5b9-3539-48e3-9b34-00c5061bdee6}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
124502024-11-09T02:58:33.713ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
124512024-11-09T02:58:33.713ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe321ec3-1504-4b0c-b50b-0584cc01ee18", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124522024-11-09T02:58:33.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124532024-11-09T02:58:33.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124542024-11-09T02:58:33.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124552024-11-09T02:58:33.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124562024-11-09T02:58:33.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124572024-11-09T02:58:33.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124582024-11-09T02:58:33.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124592024-11-09T02:58:33.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124602024-11-09T02:58:33.726ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
124612024-11-09T02:58:33.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124622024-11-09T02:58:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124632024-11-09T02:58:33.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124642024-11-09T02:58:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124652024-11-09T02:58:33.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124662024-11-09T02:58:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124672024-11-09T02:58:33.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124682024-11-09T02:58:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124692024-11-09T02:58:33.738ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124702024-11-09T02:58:33.738ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124712024-11-09T02:58:33.738ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124722024-11-09T02:58:33.740ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124732024-11-09T02:58:33.741ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca05a8b9-8c67-470d-8a14-be2414ea19ef", "content-length": "134", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124742024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124752024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
124762024-11-09T02:58:33.741ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ce0c5db-959f-4de8-8bf5-fc06594696d9", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124772024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124782024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124792024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124802024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124812024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124822024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124832024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124842024-11-09T02:58:33.741ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124852024-11-09T02:58:33.742ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
124862024-11-09T02:58:33.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124872024-11-09T02:58:33.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124882024-11-09T02:58:33.743ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 572.427289ms iteration = 25 status = {}
124892024-11-09T02:58:33.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124902024-11-09T02:58:33.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "672b18cd-b9ee-47ed-a687-cc343fa1bcfc", "content-length": "2", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124912024-11-09T02:58:33.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124922024-11-09T02:58:33.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb9720c2-cb35-4dfe-9547-0f3fade527bb", "content-length": "52", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124932024-11-09T02:58:33.744ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
124942024-11-09T02:58:33.744ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124952024-11-09T02:58:33.882ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a9150440-757e-46f5-a1fd-23fa65d9ba4f", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124962024-11-09T02:58:33.882ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
124972024-11-09T02:58:33.882ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124982024-11-09T02:58:33.883ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "94d15d35-ab95-49d9-b852-60551c053613", "content-length": "682", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
124992024-11-09T02:58:33.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125002024-11-09T02:58:33.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125012024-11-09T02:58:33.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125022024-11-09T02:58:33.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125032024-11-09T02:58:33.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125042024-11-09T02:58:33.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125052024-11-09T02:58:33.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125062024-11-09T02:58:33.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125072024-11-09T02:58:33.902ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.68997ms iteration = 25 status = {}
125082024-11-09T02:58:34.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5057e435-98cb-4ed2-8a9a-b85741c2bb4e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125092024-11-09T02:58:34.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5057e435-98cb-4ed2-8a9a-b85741c2bb4e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125102024-11-09T02:58:34.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5057e435-98cb-4ed2-8a9a-b85741c2bb4e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125112024-11-09T02:58:35.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fd87c6e9-2751-4c23-b78c-185c4219e775 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125122024-11-09T02:58:35.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fd87c6e9-2751-4c23-b78c-185c4219e775 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125132024-11-09T02:58:35.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fd87c6e9-2751-4c23-b78c-185c4219e775 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125142024-11-09T02:58:36.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91c12579-b2c7-40e7-bf65-a79841660009 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125152024-11-09T02:58:36.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91c12579-b2c7-40e7-bf65-a79841660009 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125162024-11-09T02:58:36.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 91c12579-b2c7-40e7-bf65-a79841660009 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125172024-11-09T02:58:37.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4253ea4f-cbd7-44d4-a73e-792597bba680 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125182024-11-09T02:58:37.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4253ea4f-cbd7-44d4-a73e-792597bba680 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125192024-11-09T02:58:37.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4253ea4f-cbd7-44d4-a73e-792597bba680 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125202024-11-09T02:58:38.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df8f9825-4ef5-43fc-8097-cdba1d2ae077 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125212024-11-09T02:58:38.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df8f9825-4ef5-43fc-8097-cdba1d2ae077 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125222024-11-09T02:58:38.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df8f9825-4ef5-43fc-8097-cdba1d2ae077 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125232024-11-09T02:58:39.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ec4d2452-d21b-4921-a4f6-b284eacc9487 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125242024-11-09T02:58:39.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ec4d2452-d21b-4921-a4f6-b284eacc9487 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125252024-11-09T02:58:39.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ec4d2452-d21b-4921-a4f6-b284eacc9487 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125262024-11-09T02:58:39.993ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/cb313128-bef6-4891-a142-8c709c04545b/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a3555f4-8009-4e7b-ba03-8b2dedfb672e", "content-length": "131", "date": "Sat, 09 Nov 2024 02:58:39 GMT"} })
125272024-11-09T02:58:39.998ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T02:58:31.725276121Z }, migration_in: None, migration_out: None } vmm_id = cb313128-bef6-4891-a142-8c709c04545b
125282024-11-09T02:58:39.998ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 vmm_id = cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T02:58:31.725276121Z }
125292024-11-09T02:58:39.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 roles = RoleSet { roles: {} } sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 vmm_id = cb313128-bef6-4891-a142-8c709c04545b
125302024-11-09T02:58:39.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 resource = Database result = Ok(()) sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 vmm_id = cb313128-bef6-4891-a142-8c709c04545b
125312024-11-09T02:58:40.007ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 410d849d-6a1a-4dd8-829b-9c6587576e05 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-09T02:58:39.994768387Z }
125322024-11-09T02:58:40.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 410d849d-6a1a-4dd8-829b-9c6587576e05 roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125332024-11-09T02:58:40.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 410d849d-6a1a-4dd8-829b-9c6587576e05 resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125342024-11-09T02:58:40.011ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
125352024-11-09T02:58:40.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.841479236s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
125362024-11-09T02:58:40.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27551 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 410d849d-6a1a-4dd8-829b-9c6587576e05 response_code = 204 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125372024-11-09T02:58:40.024ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ae0e966-45d2-4be6-81ff-c6c0d72fb006 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-09T02:58:40.023993151Z }
125382024-11-09T02:58:40.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ae0e966-45d2-4be6-81ff-c6c0d72fb006 roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125392024-11-09T02:58:40.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ae0e966-45d2-4be6-81ff-c6c0d72fb006 resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125402024-11-09T02:58:40.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41822 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ae0e966-45d2-4be6-81ff-c6c0d72fb006 response_code = 204 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125412024-11-09T02:58:40.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 796539b5-20f4-40ec-824f-91f98dd21906 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125422024-11-09T02:58:40.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 796539b5-20f4-40ec-824f-91f98dd21906 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125432024-11-09T02:58:40.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 796539b5-20f4-40ec-824f-91f98dd21906 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125442024-11-09T02:58:41.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6607bebb-5c36-4f7e-a071-75e93baadcdd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125452024-11-09T02:58:41.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6607bebb-5c36-4f7e-a071-75e93baadcdd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125462024-11-09T02:58:41.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 6607bebb-5c36-4f7e-a071-75e93baadcdd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125472024-11-09T02:58:42.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 15fcd418-3586-4112-b38f-fde882cbc2fe roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125482024-11-09T02:58:42.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 15fcd418-3586-4112-b38f-fde882cbc2fe resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125492024-11-09T02:58:42.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 15fcd418-3586-4112-b38f-fde882cbc2fe response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125502024-11-09T02:58:43.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
125512024-11-09T02:58:43.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
125522024-11-09T02:58:43.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125532024-11-09T02:58:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125542024-11-09T02:58:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125552024-11-09T02:58:43.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125562024-11-09T02:58:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125572024-11-09T02:58:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125582024-11-09T02:58:43.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125592024-11-09T02:58:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125602024-11-09T02:58:43.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125612024-11-09T02:58:43.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125622024-11-09T02:58:43.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125632024-11-09T02:58:43.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
125642024-11-09T02:58:43.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125652024-11-09T02:58:43.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125662024-11-09T02:58:43.194ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
125672024-11-09T02:58:43.194ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.20914ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
125682024-11-09T02:58:43.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125692024-11-09T02:58:43.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125702024-11-09T02:58:43.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.217655ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125712024-11-09T02:58:43.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a94c8ef-dee6-43f6-845e-59b55bb044b9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125722024-11-09T02:58:43.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a94c8ef-dee6-43f6-845e-59b55bb044b9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125732024-11-09T02:58:43.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a94c8ef-dee6-43f6-845e-59b55bb044b9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125742024-11-09T02:58:44.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1bf79211-9f72-43e7-aba7-71a4ba69cd23 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125752024-11-09T02:58:44.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1bf79211-9f72-43e7-aba7-71a4ba69cd23 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125762024-11-09T02:58:44.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1bf79211-9f72-43e7-aba7-71a4ba69cd23 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125772024-11-09T02:58:45.155ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3066 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 1a9d3305-068a-4cf5-ac43-dd09f83a1bc5 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
125782024-11-09T02:58:45.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9cf3ece1-0811-4541-8ffb-09665b10145e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125792024-11-09T02:58:45.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9cf3ece1-0811-4541-8ffb-09665b10145e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125802024-11-09T02:58:45.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9cf3ece1-0811-4541-8ffb-09665b10145e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125812024-11-09T02:58:46.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79880312-8cd5-4228-aa84-6aaaf756e52a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125822024-11-09T02:58:46.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79880312-8cd5-4228-aa84-6aaaf756e52a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125832024-11-09T02:58:46.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79880312-8cd5-4228-aa84-6aaaf756e52a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125842024-11-09T02:58:47.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5aa8ea0f-6543-40e3-81fc-73955a8246d3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125852024-11-09T02:58:47.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5aa8ea0f-6543-40e3-81fc-73955a8246d3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125862024-11-09T02:58:47.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5aa8ea0f-6543-40e3-81fc-73955a8246d3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125872024-11-09T02:58:48.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3441cc40-cd3c-42bd-966c-72036feab57d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125882024-11-09T02:58:48.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3441cc40-cd3c-42bd-966c-72036feab57d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125892024-11-09T02:58:48.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3441cc40-cd3c-42bd-966c-72036feab57d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125902024-11-09T02:58:49.478ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3c18f11e-f40f-4bda-820d-2cfecd94a37b uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-09T02:58:49.477974515Z }
125912024-11-09T02:58:49.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3c18f11e-f40f-4bda-820d-2cfecd94a37b roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125922024-11-09T02:58:49.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3c18f11e-f40f-4bda-820d-2cfecd94a37b resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125932024-11-09T02:58:49.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10189 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3c18f11e-f40f-4bda-820d-2cfecd94a37b response_code = 204 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
125942024-11-09T02:58:49.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9beb0ed7-50f9-487f-b8b8-dc4d46138fac roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125952024-11-09T02:58:49.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9beb0ed7-50f9-487f-b8b8-dc4d46138fac resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125962024-11-09T02:58:49.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9beb0ed7-50f9-487f-b8b8-dc4d46138fac response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
125972024-11-09T02:58:50.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 49cbbfe9-4a81-460e-b018-609dc479b894 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
125982024-11-09T02:58:50.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 49cbbfe9-4a81-460e-b018-609dc479b894 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
125992024-11-09T02:58:50.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 49cbbfe9-4a81-460e-b018-609dc479b894 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
126002024-11-09T02:58:50.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a4e9951f-a9ef-4e02-a8ae-d8e0ad573d75 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126012024-11-09T02:58:50.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a4e9951f-a9ef-4e02-a8ae-d8e0ad573d75 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126022024-11-09T02:58:50.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = a4e9951f-a9ef-4e02-a8ae-d8e0ad573d75 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126032024-11-09T02:58:50.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ee5d2d7-83c2-43a1-911a-667b219aa796 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
126042024-11-09T02:58:50.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ee5d2d7-83c2-43a1-911a-667b219aa796 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
126052024-11-09T02:58:50.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8ee5d2d7-83c2-43a1-911a-667b219aa796 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
126062024-11-09T02:58:51.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 12f8f039-7136-41cc-a77a-2a9a4cb46f93 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126072024-11-09T02:58:51.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 12f8f039-7136-41cc-a77a-2a9a4cb46f93 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126082024-11-09T02:58:51.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 12f8f039-7136-41cc-a77a-2a9a4cb46f93 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126092024-11-09T02:58:51.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f29dd959-43f7-48fb-aa42-36cfa3db33d0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
126102024-11-09T02:58:51.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f29dd959-43f7-48fb-aa42-36cfa3db33d0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
126112024-11-09T02:58:51.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f29dd959-43f7-48fb-aa42-36cfa3db33d0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
126122024-11-09T02:58:51.966ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T02:58:51.966399581Z }
126132024-11-09T02:58:51.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126142024-11-09T02:58:51.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126152024-11-09T02:58:51.983ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = cb313128-bef6-4891-a142-8c709c04545b remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_needs_update = true
126162024-11-09T02:58:51.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126172024-11-09T02:58:51.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126182024-11-09T02:58:51.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126192024-11-09T02:58:51.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126202024-11-09T02:58:51.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126212024-11-09T02:58:51.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126222024-11-09T02:58:51.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126232024-11-09T02:58:51.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126242024-11-09T02:58:51.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126252024-11-09T02:58:51.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126262024-11-09T02:58:51.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126272024-11-09T02:58:51.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126282024-11-09T02:58:51.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126292024-11-09T02:58:52.001ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 80b85a0b-333c-468c-9cee-5d2eba219497, lookup_type: ById(80b85a0b-333c-468c-9cee-5d2eba219497) } result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126302024-11-09T02:58:52.006ZINFOnexus (dropshot_internal): starting update saga for 80b85a0b-333c-468c-9cee-5d2eba219497 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T02:58:51.966399581Z }
126312024-11-09T02:58:52.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39997 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f response_code = 204 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126322024-11-09T02:58:52.007ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60c0beb6-1bca-4f4f-9fed-f36721a76c4c uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T02:58:51.966399581Z }
126332024-11-09T02:58:52.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60c0beb6-1bca-4f4f-9fed-f36721a76c4c roles = RoleSet { roles: {} } uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126342024-11-09T02:58:52.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60c0beb6-1bca-4f4f-9fed-f36721a76c4c resource = Database result = Ok(()) uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126352024-11-09T02:58:52.009ZDEBGnexus (dropshot_internal): preparing instance-update saga for 80b85a0b-333c-468c-9cee-5d2eba219497... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c94a46be-7af2-4baf-86fc-15b33109944f uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126362024-11-09T02:58:52.009ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update
126372024-11-09T02:58:52.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3897 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 60c0beb6-1bca-4f4f-9fed-f36721a76c4c response_code = 204 uri = /vmms/cb313128-bef6-4891-a142-8c709c04545b
126382024-11-09T02:58:52.019ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"80b85a0b-333c-468c-9cee-5d2eba219497","lookup_type":{"ById":"80b85a0b-333c-468c-9cee-5d2eba219497"},"parent":{"key":"5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb","lookup_type":{"ById":"5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb"},"parent":{"key":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","lookup_type":{"ById":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126392024-11-09T02:58:52.019ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update
126402024-11-09T02:58:52.076ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update
126412024-11-09T02:58:52.076ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126422024-11-09T02:58:52.076ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126432024-11-09T02:58:52.076ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126442024-11-09T02:58:52.108ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126452024-11-09T02:58:52.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126462024-11-09T02:58:52.120ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126472024-11-09T02:58:52.120ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126482024-11-09T02:58:52.129ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126492024-11-09T02:58:52.129ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9")) node_id = 0 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126502024-11-09T02:58:52.134ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126512024-11-09T02:58:52.134ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126522024-11-09T02:58:52.156ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update
126532024-11-09T02:58:52.163ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126542024-11-09T02:58:52.163ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126552024-11-09T02:58:52.166ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126562024-11-09T02:58:52.166ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126572024-11-09T02:58:52.168ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126582024-11-09T02:58:52.168ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126592024-11-09T02:58:52.172ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126602024-11-09T02:58:52.173ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126612024-11-09T02:58:52.174ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126622024-11-09T02:58:52.174ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126632024-11-09T02:58:52.176ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126642024-11-09T02:58:52.176ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126652024-11-09T02:58:52.178ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126662024-11-09T02:58:52.183ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 80b85a0b-333c-468c-9cee-5d2eba219497, lookup_type: ById(80b85a0b-333c-468c-9cee-5d2eba219497) } result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126672024-11-09T02:58:52.183ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance updater_id = da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9
126682024-11-09T02:58:52.183ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126692024-11-09T02:58:52.183ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126702024-11-09T02:58:52.200ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance updater_id = da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9
126712024-11-09T02:58:52.200ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126722024-11-09T02:58:52.200ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance
126732024-11-09T02:58:52.204ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 locked_gen = Generation(Generation(2)) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = LockInstance updater_id = da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9
126742024-11-09T02:58:52.204ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126752024-11-09T02:58:52.204ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9")}) node_id = 1 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126762024-11-09T02:58:52.211ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126772024-11-09T02:58:52.211ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
126782024-11-09T02:58:52.219ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126792024-11-09T02:58:52.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126802024-11-09T02:58:52.220ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126812024-11-09T02:58:52.220ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126822024-11-09T02:58:52.226ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126832024-11-09T02:58:52.226ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126842024-11-09T02:58:52.228ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126852024-11-09T02:58:52.231ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 80b85a0b-333c-468c-9cee-5d2eba219497, lookup_type: ById(80b85a0b-333c-468c-9cee-5d2eba219497) } result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126862024-11-09T02:58:52.231ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126872024-11-09T02:58:52.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
126882024-11-09T02:58:52.239ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: cb313128-bef6-4891-a142-8c709c04545b, time_created: 2024-11-09T02:58:31.181001Z, time_deleted: None, instance_id: 80b85a0b-333c-468c-9cee-5d2eba219497, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-09T02:58:51.966399Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-09T02:58:28.401723Z, gen: Generation(Generation(3)), propolis_id: Some(cb313128-bef6-4891-a142-8c709c04545b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(cb313128-bef6-4891-a142-8c709c04545b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-09T02:58:52.239814591Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
126892024-11-09T02:58:52.245ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
126902024-11-09T02:58:52.245ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"80b85a0b-333c-468c-9cee-5d2eba219497","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"cb313128-bef6-4891-a142-8c709c04545b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"80b85a0b-333c-468c-9cee-5d2eba219497","lookup_type":{"ById":"80b85a0b-333c-468c-9cee-5d2eba219497"},"parent":{"key":"5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb","lookup_type":{"ById":"5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb"},"parent":{"key":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","lookup_type":{"ById":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb","ram_diff":1073741824},"destroy_active_vmm":"cb313128-bef6-4891-a142-8c709c04545b","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-09T02:58:52.239814591Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126912024-11-09T02:58:52.245ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
126922024-11-09T02:58:52.251ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
126932024-11-09T02:58:52.251ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126942024-11-09T02:58:52.251ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126952024-11-09T02:58:52.251ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
126962024-11-09T02:58:52.258ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126972024-11-09T02:58:52.258ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
126982024-11-09T02:58:52.263ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
126992024-11-09T02:58:52.263ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127002024-11-09T02:58:52.266ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127012024-11-09T02:58:52.266ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ceec2dab-c6ca-49b0-993a-304445af5968")) node_id = 0 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127022024-11-09T02:58:52.270ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127032024-11-09T02:58:52.270ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127042024-11-09T02:58:52.280ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 parent_lock = UpdaterLock { updater_id: da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9, locked_gen: Generation(Generation(2)) } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127052024-11-09T02:58:52.280ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = BecomeUpdater
127062024-11-09T02:58:52.280ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = BecomeUpdater
127072024-11-09T02:58:52.295ZDEBGnexus (SagaExecutor): inherited lock from da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9 to ceec2dab-c6ca-49b0-993a-304445af5968 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = BecomeUpdater updater_id = ceec2dab-c6ca-49b0-993a-304445af5968
127082024-11-09T02:58:52.295ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127092024-11-09T02:58:52.295ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127102024-11-09T02:58:52.295ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ceec2dab-c6ca-49b0-993a-304445af5968")}) node_id = 1 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127112024-11-09T02:58:52.301ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127122024-11-09T02:58:52.301ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127132024-11-09T02:58:52.304ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127142024-11-09T02:58:52.304ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127152024-11-09T02:58:52.310ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127162024-11-09T02:58:52.310ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127172024-11-09T02:58:52.314ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127182024-11-09T02:58:52.317ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497
127192024-11-09T02:58:52.317ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UpdateNetworkConfig
127202024-11-09T02:58:52.317ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UpdateNetworkConfig
127212024-11-09T02:58:52.323ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UpdateNetworkConfig
127222024-11-09T02:58:52.323ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UpdateNetworkConfig
127232024-11-09T02:58:52.325ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
127242024-11-09T02:58:52.325ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UpdateNetworkConfig
127252024-11-09T02:58:52.325ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UpdateNetworkConfig
127262024-11-09T02:58:52.328ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
127272024-11-09T02:58:52.328ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
127282024-11-09T02:58:52.328ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
127292024-11-09T02:58:52.329ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
127302024-11-09T02:58:52.330ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
127312024-11-09T02:58:52.330ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
127322024-11-09T02:58:52.330ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
127332024-11-09T02:58:52.336ZDEBGnexus: notifying dendrite of updates instance_id = Some(80b85a0b-333c-468c-9cee-5d2eba219497 (instance)) switch = switch0
127342024-11-09T02:58:52.336ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 672064731 } })
127352024-11-09T02:58:52.336ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
127362024-11-09T02:58:52.366ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
127372024-11-09T02:58:52.366ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
127382024-11-09T02:58:52.366ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6598dad5-a294-4fe5-8a15-cffdd28cc6a0", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:52 GMT"} })
127392024-11-09T02:58:52.366ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
127402024-11-09T02:58:52.367ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
127412024-11-09T02:58:52.397ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
127422024-11-09T02:58:52.397ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "c431123c-12ad-453f-8c5a-a47eff0d33af", "content-length": "4", "date": "Sat, 09 Nov 2024 02:58:51 GMT"} })
127432024-11-09T02:58:52.398ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127442024-11-09T02:58:52.398ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127452024-11-09T02:58:52.402ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127462024-11-09T02:58:52.402ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127472024-11-09T02:58:52.411ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
127482024-11-09T02:58:52.411ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
127492024-11-09T02:58:52.428ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-09T02:58:52.413988Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, time_modified: Some(2024-11-09T02:58:52.413988Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, time_modified: Some(2024-11-09T02:58:52.413988Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127502024-11-09T02:58:52.428ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127512024-11-09T02:58:52.428ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127522024-11-09T02:58:52.434ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127532024-11-09T02:58:52.434ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127542024-11-09T02:58:52.441ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127552024-11-09T02:58:52.441ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UnassignOximeterProducer
127562024-11-09T02:58:52.442ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UnassignOximeterProducer
127572024-11-09T02:58:52.447ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 producer_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127582024-11-09T02:58:52.447ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UnassignOximeterProducer
127592024-11-09T02:58:52.447ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = UnassignOximeterProducer
127602024-11-09T02:58:52.485ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127612024-11-09T02:58:52.488ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/80b85a0b-333c-468c-9cee-5d2eba219497
127622024-11-09T02:58:52.507ZDEBGnexus (SagaExecutor): client response oximeter-collector = 80b85a0b-333c-468c-9cee-5d2eba219497 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/80b85a0b-333c-468c-9cee-5d2eba219497", status: 204, headers: {"x-request-id": "ef34734f-870c-437c-a85b-8f1ca4b1ac0c", "date": "Sat, 09 Nov 2024 02:58:52 GMT"} }) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127632024-11-09T02:58:52.507ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 producer_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127642024-11-09T02:58:52.508ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127652024-11-09T02:58:52.508ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127662024-11-09T02:58:52.513ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127672024-11-09T02:58:52.513ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127682024-11-09T02:58:52.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 3994273a-760e-47be-ae45-16b1c099f822 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
127692024-11-09T02:58:52.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 3994273a-760e-47be-ae45-16b1c099f822 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
127702024-11-09T02:58:52.520ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 lock = UpdaterLock { updater_id: ceec2dab-c6ca-49b0-993a-304445af5968, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-09T02:58:52.239814591Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127712024-11-09T02:58:52.520ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = CommitInstanceUpdates
127722024-11-09T02:58:52.520ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = CommitInstanceUpdates
127732024-11-09T02:58:52.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 3994273a-760e-47be-ae45-16b1c099f822 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
127742024-11-09T02:58:52.564ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 new_runtime = InstanceRuntimeState { time_updated: 2024-11-09T02:58:52.239814591Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
127752024-11-09T02:58:52.564ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
127762024-11-09T02:58:52.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127772024-11-09T02:58:52.564ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127782024-11-09T02:58:52.564ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127792024-11-09T02:58:52.564ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
127802024-11-09T02:58:52.564ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127812024-11-09T02:58:52.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127822024-11-09T02:58:52.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127832024-11-09T02:58:52.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127842024-11-09T02:58:52.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127852024-11-09T02:58:52.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127862024-11-09T02:58:52.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127872024-11-09T02:58:52.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127882024-11-09T02:58:52.569ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127892024-11-09T02:58:52.569ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127902024-11-09T02:58:52.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127912024-11-09T02:58:52.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127922024-11-09T02:58:52.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127932024-11-09T02:58:52.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127942024-11-09T02:58:52.575ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127952024-11-09T02:58:52.575ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("80b85a0b-333c-468c-9cee-5d2eba219497"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cb313128-bef6-4891-a142-8c709c04545b")}) node_id = 7 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127962024-11-09T02:58:52.579ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127972024-11-09T02:58:52.579ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
127982024-11-09T02:58:52.582ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
127992024-11-09T02:58:52.582ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128002024-11-09T02:58:52.586ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128012024-11-09T02:58:52.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128022024-11-09T02:58:52.592ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 propolis_id = cb313128-bef6-4891-a142-8c709c04545b saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
128032024-11-09T02:58:52.592ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ReleaseSledResources
128042024-11-09T02:58:52.592ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ReleaseSledResources
128052024-11-09T02:58:52.605ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128062024-11-09T02:58:52.605ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128072024-11-09T02:58:52.605ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e713802-1f07-4707-848d-452526ff200c", "content-length": "372", "date": "Sat, 09 Nov 2024 02:58:52 GMT"} })
128082024-11-09T02:58:52.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128092024-11-09T02:58:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128102024-11-09T02:58:52.616ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128112024-11-09T02:58:52.616ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128122024-11-09T02:58:52.618ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {2945403d-7dac-4915-b39b-33737fbebf32: {10.151.1.176: {0df7e5b9-3539-48e3-9b34-00c5061bdee6}, 10.151.1.175: {0df7e5b9-3539-48e3-9b34-00c5061bdee6}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
128132024-11-09T02:58:52.618ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128142024-11-09T02:58:52.619ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c3cb5a66-6643-4c81-9cad-a7d6972b5fba", "date": "Sat, 09 Nov 2024 02:58:52 GMT"} })
128152024-11-09T02:58:52.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128162024-11-09T02:58:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128172024-11-09T02:58:52.620ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128182024-11-09T02:58:52.620ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128192024-11-09T02:58:52.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128202024-11-09T02:58:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128212024-11-09T02:58:52.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128222024-11-09T02:58:52.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128232024-11-09T02:58:52.626ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 propolis_id = cb313128-bef6-4891-a142-8c709c04545b saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
128242024-11-09T02:58:52.626ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = MarkVmmDeleted
128252024-11-09T02:58:52.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = MarkVmmDeleted
128262024-11-09T02:58:52.627ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128272024-11-09T02:58:52.627ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128282024-11-09T02:58:52.627ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "948404d7-d2b1-4703-8727-29a872a47fc9", "date": "Sat, 09 Nov 2024 02:58:52 GMT"} })
128292024-11-09T02:58:52.629ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 65.634097ms iteration = 26 status = {}
128302024-11-09T02:58:52.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1070aa7-f6f7-4c85-8dc7-3b40d682eaf8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
128312024-11-09T02:58:52.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1070aa7-f6f7-4c85-8dc7-3b40d682eaf8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
128322024-11-09T02:58:52.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e1070aa7-f6f7-4c85-8dc7-3b40d682eaf8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
128332024-11-09T02:58:52.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128342024-11-09T02:58:52.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128352024-11-09T02:58:52.672ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128362024-11-09T02:58:52.672ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128372024-11-09T02:58:52.681ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128382024-11-09T02:58:52.681ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128392024-11-09T02:58:52.685ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128402024-11-09T02:58:52.685ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128412024-11-09T02:58:52.691ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128422024-11-09T02:58:52.691ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128432024-11-09T02:58:52.695ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128442024-11-09T02:58:52.695ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128452024-11-09T02:58:52.697ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128462024-11-09T02:58:52.697ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128472024-11-09T02:58:52.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128482024-11-09T02:58:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128492024-11-09T02:58:52.698ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128502024-11-09T02:58:52.699ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128512024-11-09T02:58:52.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128522024-11-09T02:58:52.700ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128532024-11-09T02:58:52.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128542024-11-09T02:58:52.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128552024-11-09T02:58:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128562024-11-09T02:58:52.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128572024-11-09T02:58:52.703ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 80b85a0b-333c-468c-9cee-5d2eba219497, lookup_type: ById(80b85a0b-333c-468c-9cee-5d2eba219497) } result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128582024-11-09T02:58:52.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128592024-11-09T02:58:52.704ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_node = ChainSuccessorSaga
128602024-11-09T02:58:52.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128612024-11-09T02:58:52.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128622024-11-09T02:58:52.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128632024-11-09T02:58:52.708ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update
128642024-11-09T02:58:52.708ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128652024-11-09T02:58:52.708ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128662024-11-09T02:58:52.708ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
128672024-11-09T02:58:52.708ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
128682024-11-09T02:58:52.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128692024-11-09T02:58:52.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128702024-11-09T02:58:52.711ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128712024-11-09T02:58:52.711ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128722024-11-09T02:58:52.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128732024-11-09T02:58:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128742024-11-09T02:58:52.713ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128752024-11-09T02:58:52.713ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
128762024-11-09T02:58:52.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128772024-11-09T02:58:52.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128782024-11-09T02:58:52.713ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128792024-11-09T02:58:52.714ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128802024-11-09T02:58:52.738ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128812024-11-09T02:58:52.739ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1024fd78-c18f-4093-99b4-af3587ac9737", "content-length": "691", "date": "Sat, 09 Nov 2024 02:58:52 GMT"} })
128822024-11-09T02:58:52.739ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
128832024-11-09T02:58:52.739ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
128842024-11-09T02:58:52.739ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
128852024-11-09T02:58:52.740ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128862024-11-09T02:58:52.740ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
128872024-11-09T02:58:52.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 31.817928ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
128882024-11-09T02:58:52.741ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 177.461558ms iteration = 26 status = {}
128892024-11-09T02:58:52.745ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128902024-11-09T02:58:52.745ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128912024-11-09T02:58:52.751ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128922024-11-09T02:58:52.751ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84
128932024-11-09T02:58:52.790ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128942024-11-09T02:58:52.790ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 saga_name = instance-update saga_result = SagaResult { saga_id: 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84, saga_log: SagaLog { saga_id: 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("ceec2dab-c6ca-49b0-993a-304445af5968")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ceec2dab-c6ca-49b0-993a-304445af5968")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("80b85a0b-333c-468c-9cee-5d2eba219497"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cb313128-bef6-4891-a142-8c709c04545b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("80b85a0b-333c-468c-9cee-5d2eba219497"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cb313128-bef6-4891-a142-8c709c04545b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ceec2dab-c6ca-49b0-993a-304445af5968"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ceec2dab-c6ca-49b0-993a-304445af5968")}} }) }
128952024-11-09T02:58:52.790ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 42a45c5e-c0e1-4154-8a5e-00f3fbfa5b84 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update
128962024-11-09T02:58:52.790ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128972024-11-09T02:58:52.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
128982024-11-09T02:58:52.796ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
128992024-11-09T02:58:52.796ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
129002024-11-09T02:58:52.800ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
129012024-11-09T02:58:52.800ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
129022024-11-09T02:58:52.805ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
129032024-11-09T02:58:52.805ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250
129042024-11-09T02:58:52.841ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update sec_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
129052024-11-09T02:58:52.841ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a4e36bb9-7059-4867-a9cd-5e9fa9f15250 saga_name = start-instance-update saga_result = SagaResult { saga_id: a4e36bb9-7059-4867-a9cd-5e9fa9f15250, saga_log: SagaLog { saga_id: a4e36bb9-7059-4867-a9cd-5e9fa9f15250, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("da8ac7c4-0f23-4cdc-b927-9a26d48ebaa9")}} }) }
129062024-11-09T02:58:53.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
129072024-11-09T02:58:53.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
129082024-11-09T02:58:53.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129092024-11-09T02:58:53.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129102024-11-09T02:58:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129112024-11-09T02:58:53.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129122024-11-09T02:58:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129132024-11-09T02:58:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129142024-11-09T02:58:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129152024-11-09T02:58:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129162024-11-09T02:58:53.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129172024-11-09T02:58:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129182024-11-09T02:58:53.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129192024-11-09T02:58:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
129202024-11-09T02:58:53.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129212024-11-09T02:58:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129222024-11-09T02:58:53.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
129232024-11-09T02:58:53.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.831111ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
129242024-11-09T02:58:53.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129252024-11-09T02:58:53.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129262024-11-09T02:58:53.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.264767ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129272024-11-09T02:58:53.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de83daa4-d1ab-47f3-8413-3287cf768b6e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129282024-11-09T02:58:53.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de83daa4-d1ab-47f3-8413-3287cf768b6e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129292024-11-09T02:58:53.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = de83daa4-d1ab-47f3-8413-3287cf768b6e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129302024-11-09T02:58:54.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 14b1cd54-7b69-46e5-bfd5-e68c68937e21 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129312024-11-09T02:58:54.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 14b1cd54-7b69-46e5-bfd5-e68c68937e21 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129322024-11-09T02:58:54.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 14b1cd54-7b69-46e5-bfd5-e68c68937e21 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129332024-11-09T02:58:55.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be285da8-2634-4b65-802a-b7fc357558f6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129342024-11-09T02:58:55.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be285da8-2634-4b65-802a-b7fc357558f6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129352024-11-09T02:58:55.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = be285da8-2634-4b65-802a-b7fc357558f6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129362024-11-09T02:58:56.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c3e63c5-620b-4ec0-8a7a-4e4463cceb11 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129372024-11-09T02:58:56.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c3e63c5-620b-4ec0-8a7a-4e4463cceb11 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129382024-11-09T02:58:56.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7c3e63c5-620b-4ec0-8a7a-4e4463cceb11 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129392024-11-09T02:58:57.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf2ec334-67b2-43b0-abaf-edc04b1426dd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129402024-11-09T02:58:57.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf2ec334-67b2-43b0-abaf-edc04b1426dd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129412024-11-09T02:58:57.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf2ec334-67b2-43b0-abaf-edc04b1426dd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129422024-11-09T02:58:58.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 895aa9e2-7f7e-41ed-9529-d4255cc358f1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129432024-11-09T02:58:58.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 895aa9e2-7f7e-41ed-9529-d4255cc358f1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129442024-11-09T02:58:58.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 895aa9e2-7f7e-41ed-9529-d4255cc358f1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129452024-11-09T02:58:59.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d837157-afd1-4138-a603-41f39fa4fa0f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129462024-11-09T02:58:59.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d837157-afd1-4138-a603-41f39fa4fa0f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129472024-11-09T02:58:59.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d837157-afd1-4138-a603-41f39fa4fa0f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129482024-11-09T02:59:00.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 729 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = ccd1d511-1f30-4d20-abcb-d692031c7fae response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
129492024-11-09T02:59:00.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 54188a11-ff12-41c3-820f-357a2fbc636d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129502024-11-09T02:59:00.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 54188a11-ff12-41c3-820f-357a2fbc636d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129512024-11-09T02:59:00.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 54188a11-ff12-41c3-820f-357a2fbc636d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129522024-11-09T02:59:01.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d6e5554d-b1f8-4e5b-be83-d857fcb49dc4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129532024-11-09T02:59:01.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d6e5554d-b1f8-4e5b-be83-d857fcb49dc4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129542024-11-09T02:59:01.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d6e5554d-b1f8-4e5b-be83-d857fcb49dc4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129552024-11-09T02:59:02.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce57ce89-ed36-4d34-80d4-a09a31bfbaf8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129562024-11-09T02:59:02.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce57ce89-ed36-4d34-80d4-a09a31bfbaf8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129572024-11-09T02:59:02.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ce57ce89-ed36-4d34-80d4-a09a31bfbaf8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
129582024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
129592024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
129602024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129612024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
129622024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129632024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
129642024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129652024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
129662024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129672024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129682024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
129692024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
129702024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
129712024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129722024-11-09T02:59:03.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
129732024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129742024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
129752024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129762024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
129772024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
129782024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
129792024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
129802024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129812024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
129822024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
129832024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
129842024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129852024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129862024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129872024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129882024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129892024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129902024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129912024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129922024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129932024-11-09T02:59:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129942024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
129952024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129962024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
129972024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
129982024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
129992024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
130002024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.401\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
130012024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.01\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
130022024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.86\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
130032024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
130042024-11-09T02:59:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.23\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
130052024-11-09T02:59:03.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130062024-11-09T02:59:03.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130072024-11-09T02:59:03.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130082024-11-09T02:59:03.175ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.540713ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
130092024-11-09T02:59:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
130102024-11-09T02:59:03.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
130112024-11-09T02:59:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130122024-11-09T02:59:03.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130132024-11-09T02:59:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
130142024-11-09T02:59:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130152024-11-09T02:59:03.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130162024-11-09T02:59:03.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130172024-11-09T02:59:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130182024-11-09T02:59:03.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130192024-11-09T02:59:03.181ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130202024-11-09T02:59:03.181ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 517062224 } })
130212024-11-09T02:59:03.181ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
130222024-11-09T02:59:03.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130232024-11-09T02:59:03.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130242024-11-09T02:59:03.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
130252024-11-09T02:59:03.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 517706127 } })
130262024-11-09T02:59:03.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
130272024-11-09T02:59:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
130282024-11-09T02:59:03.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130292024-11-09T02:59:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130302024-11-09T02:59:03.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130312024-11-09T02:59:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130322024-11-09T02:59:03.191ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130332024-11-09T02:59:03.191ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
130342024-11-09T02:59:03.191ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130352024-11-09T02:59:03.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130362024-11-09T02:59:03.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130372024-11-09T02:59:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130382024-11-09T02:59:03.196ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130392024-11-09T02:59:03.196ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.64935ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
130402024-11-09T02:59:03.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130412024-11-09T02:59:03.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130422024-11-09T02:59:03.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.857464ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130432024-11-09T02:59:03.211ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
130442024-11-09T02:59:03.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
130452024-11-09T02:59:03.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.881405ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130462024-11-09T02:59:03.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130472024-11-09T02:59:03.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130482024-11-09T02:59:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
130492024-11-09T02:59:03.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130502024-11-09T02:59:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130512024-11-09T02:59:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130522024-11-09T02:59:03.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130532024-11-09T02:59:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130542024-11-09T02:59:03.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130552024-11-09T02:59:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130562024-11-09T02:59:03.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130572024-11-09T02:59:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130582024-11-09T02:59:03.226ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 562063294 } })
130592024-11-09T02:59:03.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130602024-11-09T02:59:03.227ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
130612024-11-09T02:59:03.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130622024-11-09T02:59:03.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130632024-11-09T02:59:03.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130642024-11-09T02:59:03.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130652024-11-09T02:59:03.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130662024-11-09T02:59:03.235ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130672024-11-09T02:59:03.235ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130682024-11-09T02:59:03.235ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 64.257748ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130692024-11-09T02:59:03.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130702024-11-09T02:59:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
130712024-11-09T02:59:03.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130722024-11-09T02:59:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130732024-11-09T02:59:03.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130742024-11-09T02:59:03.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130752024-11-09T02:59:03.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130762024-11-09T02:59:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130772024-11-09T02:59:03.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
130782024-11-09T02:59:03.258ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130792024-11-09T02:59:03.258ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af75ecc4-0fa0-4abe-a9a2-2124a576c4c7", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
130802024-11-09T02:59:03.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130812024-11-09T02:59:03.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
130822024-11-09T02:59:03.258ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130832024-11-09T02:59:03.259ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b8ee73f-1e26-40e2-8730-8598caf9f8ae", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
130842024-11-09T02:59:03.259ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130852024-11-09T02:59:03.261ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130862024-11-09T02:59:03.261ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130872024-11-09T02:59:03.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
130882024-11-09T02:59:03.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.819159ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
130892024-11-09T02:59:03.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130902024-11-09T02:59:03.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
130912024-11-09T02:59:03.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130922024-11-09T02:59:03.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130932024-11-09T02:59:03.278ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.43509ms iteration = 26 status = 0
130942024-11-09T02:59:03.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130952024-11-09T02:59:03.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130962024-11-09T02:59:03.317ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
130972024-11-09T02:59:03.317ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130982024-11-09T02:59:03.317ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01aff7af-5fdc-4bf1-a9fe-03e25053a9da", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
130992024-11-09T02:59:03.317ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131002024-11-09T02:59:03.319ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
131012024-11-09T02:59:03.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.347342ms iteration = 29 status = {"physical_disks_added":0}
131022024-11-09T02:59:03.368ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131032024-11-09T02:59:03.369ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f738deae-ea95-4eec-a92f-b044b15fddbc", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
131042024-11-09T02:59:03.371ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131052024-11-09T02:59:03.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131062024-11-09T02:59:03.374ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.74371ms iteration = 26 status = null
131072024-11-09T02:59:03.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131082024-11-09T02:59:03.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131092024-11-09T02:59:03.404ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 233.142397ms iteration = 26 status = {}
131102024-11-09T02:59:03.416ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
131112024-11-09T02:59:03.416ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131122024-11-09T02:59:03.416ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "afb4c279-c8a5-4e9e-b6f1-424bbe15807a", "content-length": "372", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131132024-11-09T02:59:03.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131142024-11-09T02:59:03.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131152024-11-09T02:59:03.431ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
131162024-11-09T02:59:03.431ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131172024-11-09T02:59:03.431ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "43d0939b-328d-4e54-82c4-8cf0fe96387d", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131182024-11-09T02:59:03.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131192024-11-09T02:59:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131202024-11-09T02:59:03.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131212024-11-09T02:59:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131222024-11-09T02:59:03.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131232024-11-09T02:59:03.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131242024-11-09T02:59:03.440ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
131252024-11-09T02:59:03.440ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131262024-11-09T02:59:03.441ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8dd35764-2981-4a21-8a2c-f46dd101c5f5", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131272024-11-09T02:59:03.443ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.975609ms iteration = 27 status = {}
131282024-11-09T02:59:03.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131292024-11-09T02:59:03.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131302024-11-09T02:59:03.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131312024-11-09T02:59:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131322024-11-09T02:59:03.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131332024-11-09T02:59:03.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131342024-11-09T02:59:03.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131352024-11-09T02:59:03.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131362024-11-09T02:59:03.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131372024-11-09T02:59:03.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131382024-11-09T02:59:03.505ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
131392024-11-09T02:59:03.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131402024-11-09T02:59:03.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131412024-11-09T02:59:03.515ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131422024-11-09T02:59:03.515ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e25e26c6-114f-4693-ab8b-da87e80e8e6b", "content-length": "134", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131432024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131442024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
131452024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131462024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131472024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131482024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131492024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131502024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131512024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131522024-11-09T02:59:03.515ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131532024-11-09T02:59:03.516ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
131542024-11-09T02:59:03.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131552024-11-09T02:59:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131562024-11-09T02:59:03.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131572024-11-09T02:59:03.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "63839d01-34b8-4ae0-af11-bc80b7d799f5", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131582024-11-09T02:59:03.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131592024-11-09T02:59:03.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6312c48f-5cbb-4d66-bf69-0f799cd8f285", "content-length": "52", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131602024-11-09T02:59:03.518ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
131612024-11-09T02:59:03.518ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131622024-11-09T02:59:03.523ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131632024-11-09T02:59:03.613ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fc545ba-1365-42a2-b8dd-fb81a1a56f08", "content-length": "691", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131642024-11-09T02:59:03.613ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
131652024-11-09T02:59:03.613ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
131662024-11-09T02:59:03.613ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
131672024-11-09T02:59:03.614ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 443.404193ms iteration = 27 status = {}
131682024-11-09T02:59:03.716ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bfd62cfa-f7ee-4814-9b62-36fc7c0a7694", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131692024-11-09T02:59:03.716ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
131702024-11-09T02:59:03.716ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131712024-11-09T02:59:03.716ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a7d5c3c-103c-4be1-b6d9-069082fd3647", "content-length": "682", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
131722024-11-09T02:59:03.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131732024-11-09T02:59:03.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131742024-11-09T02:59:03.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131752024-11-09T02:59:03.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131762024-11-09T02:59:03.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131772024-11-09T02:59:03.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131782024-11-09T02:59:03.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131792024-11-09T02:59:03.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131802024-11-09T02:59:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 561.197457ms iteration = 26 status = {}
131812024-11-09T02:59:03.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 221b49fa-3a18-47ce-8871-52f6fe4f87fb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131822024-11-09T02:59:03.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 221b49fa-3a18-47ce-8871-52f6fe4f87fb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131832024-11-09T02:59:03.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 221b49fa-3a18-47ce-8871-52f6fe4f87fb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131842024-11-09T02:59:04.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84964c38-a878-471f-a9ef-2cea828d9604 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131852024-11-09T02:59:04.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84964c38-a878-471f-a9ef-2cea828d9604 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131862024-11-09T02:59:04.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 84964c38-a878-471f-a9ef-2cea828d9604 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131872024-11-09T02:59:05.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a50b76e-009c-4c54-a272-12a86de663da roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131882024-11-09T02:59:05.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a50b76e-009c-4c54-a272-12a86de663da resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131892024-11-09T02:59:05.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7a50b76e-009c-4c54-a272-12a86de663da response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131902024-11-09T02:59:06.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 18af5f5e-0c73-44ca-8de7-719ad95f80e7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131912024-11-09T02:59:06.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 18af5f5e-0c73-44ca-8de7-719ad95f80e7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131922024-11-09T02:59:06.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 18af5f5e-0c73-44ca-8de7-719ad95f80e7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131932024-11-09T02:59:08.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 74fab89f-b12f-4c66-8d53-d85434916152 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131942024-11-09T02:59:08.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 74fab89f-b12f-4c66-8d53-d85434916152 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131952024-11-09T02:59:08.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 74fab89f-b12f-4c66-8d53-d85434916152 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131962024-11-09T02:59:09.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dfe7a531-b71c-484b-ac9f-bd99bc846f56 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131972024-11-09T02:59:09.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dfe7a531-b71c-484b-ac9f-bd99bc846f56 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131982024-11-09T02:59:09.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dfe7a531-b71c-484b-ac9f-bd99bc846f56 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
131992024-11-09T02:59:10.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79b3a7bd-537a-43ac-8c9a-eb4aaf70cfbf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132002024-11-09T02:59:10.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79b3a7bd-537a-43ac-8c9a-eb4aaf70cfbf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132012024-11-09T02:59:10.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79b3a7bd-537a-43ac-8c9a-eb4aaf70cfbf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132022024-11-09T02:59:11.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ccdd849-c19a-48d2-9f80-f658cf4d8aa1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132032024-11-09T02:59:11.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ccdd849-c19a-48d2-9f80-f658cf4d8aa1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132042024-11-09T02:59:11.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ccdd849-c19a-48d2-9f80-f658cf4d8aa1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132052024-11-09T02:59:12.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a532a29d-b9ac-4a5e-8adf-1813e102df16 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132062024-11-09T02:59:12.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a532a29d-b9ac-4a5e-8adf-1813e102df16 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132072024-11-09T02:59:12.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a532a29d-b9ac-4a5e-8adf-1813e102df16 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132082024-11-09T02:59:13.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6cb7099-8165-4125-b9cc-8d36e9141650 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132092024-11-09T02:59:13.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6cb7099-8165-4125-b9cc-8d36e9141650 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132102024-11-09T02:59:13.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6cb7099-8165-4125-b9cc-8d36e9141650 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132112024-11-09T02:59:13.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
132122024-11-09T02:59:13.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
132132024-11-09T02:59:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132142024-11-09T02:59:13.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132152024-11-09T02:59:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132162024-11-09T02:59:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132172024-11-09T02:59:13.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132182024-11-09T02:59:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132192024-11-09T02:59:13.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132202024-11-09T02:59:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132212024-11-09T02:59:13.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132222024-11-09T02:59:13.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132232024-11-09T02:59:13.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132242024-11-09T02:59:13.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
132252024-11-09T02:59:13.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132262024-11-09T02:59:13.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132272024-11-09T02:59:13.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
132282024-11-09T02:59:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.041454ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
132292024-11-09T02:59:13.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132302024-11-09T02:59:13.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132312024-11-09T02:59:13.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.514681ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132322024-11-09T02:59:14.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8660fcd1-6065-4b9d-ba65-00515e00aea5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132332024-11-09T02:59:14.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8660fcd1-6065-4b9d-ba65-00515e00aea5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132342024-11-09T02:59:14.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8660fcd1-6065-4b9d-ba65-00515e00aea5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132352024-11-09T02:59:15.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 958 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = a608d7c7-b87a-48cd-b335-e61d962b2446 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
132362024-11-09T02:59:15.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f79aac64-47a5-4fe7-b1f5-be123ec7d994 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132372024-11-09T02:59:15.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f79aac64-47a5-4fe7-b1f5-be123ec7d994 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132382024-11-09T02:59:15.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f79aac64-47a5-4fe7-b1f5-be123ec7d994 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132392024-11-09T02:59:16.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7eb34fd2-e9ae-4eef-81ba-30defc8743e7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132402024-11-09T02:59:16.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7eb34fd2-e9ae-4eef-81ba-30defc8743e7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132412024-11-09T02:59:16.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7eb34fd2-e9ae-4eef-81ba-30defc8743e7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132422024-11-09T02:59:17.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 19d12ad1-739b-47f0-ab21-4541edb24657 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132432024-11-09T02:59:17.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 19d12ad1-739b-47f0-ab21-4541edb24657 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132442024-11-09T02:59:17.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 19d12ad1-739b-47f0-ab21-4541edb24657 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132452024-11-09T02:59:18.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c585dab4-a9fc-4a1b-9438-922299e1b679 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132462024-11-09T02:59:18.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c585dab4-a9fc-4a1b-9438-922299e1b679 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132472024-11-09T02:59:18.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c585dab4-a9fc-4a1b-9438-922299e1b679 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132482024-11-09T02:59:19.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ff3fd99-1a66-4992-b775-d90b3ea893e5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132492024-11-09T02:59:19.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ff3fd99-1a66-4992-b775-d90b3ea893e5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132502024-11-09T02:59:19.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ff3fd99-1a66-4992-b775-d90b3ea893e5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132512024-11-09T02:59:20.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d59ac0ce-a173-459e-a04d-227d85dda827 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132522024-11-09T02:59:20.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d59ac0ce-a173-459e-a04d-227d85dda827 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132532024-11-09T02:59:20.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d59ac0ce-a173-459e-a04d-227d85dda827 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132542024-11-09T02:59:21.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cca9b061-0714-4e4e-93a4-889b755d29fb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132552024-11-09T02:59:21.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cca9b061-0714-4e4e-93a4-889b755d29fb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132562024-11-09T02:59:21.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = cca9b061-0714-4e4e-93a4-889b755d29fb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132572024-11-09T02:59:22.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9998452-f4f8-467a-97bb-548876a32eeb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132582024-11-09T02:59:22.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9998452-f4f8-467a-97bb-548876a32eeb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132592024-11-09T02:59:22.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a9998452-f4f8-467a-97bb-548876a32eeb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132602024-11-09T02:59:22.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e350ed01-334c-4d53-94b7-b9aa580d986d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
132612024-11-09T02:59:22.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e350ed01-334c-4d53-94b7-b9aa580d986d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
132622024-11-09T02:59:22.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e350ed01-334c-4d53-94b7-b9aa580d986d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
132632024-11-09T02:59:23.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
132642024-11-09T02:59:23.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
132652024-11-09T02:59:23.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132662024-11-09T02:59:23.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132672024-11-09T02:59:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132682024-11-09T02:59:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132692024-11-09T02:59:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132702024-11-09T02:59:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132712024-11-09T02:59:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132722024-11-09T02:59:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132732024-11-09T02:59:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132742024-11-09T02:59:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132752024-11-09T02:59:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132762024-11-09T02:59:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
132772024-11-09T02:59:23.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132782024-11-09T02:59:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132792024-11-09T02:59:23.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
132802024-11-09T02:59:23.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.578656ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
132812024-11-09T02:59:23.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132822024-11-09T02:59:23.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132832024-11-09T02:59:23.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.283916ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132842024-11-09T02:59:23.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4f134f4-8ca8-4b8e-bbe6-5c743d09f168 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132852024-11-09T02:59:23.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4f134f4-8ca8-4b8e-bbe6-5c743d09f168 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132862024-11-09T02:59:23.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4f134f4-8ca8-4b8e-bbe6-5c743d09f168 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132872024-11-09T02:59:24.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4099fa5f-fd5b-43b6-87a2-566ce59a396f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132882024-11-09T02:59:24.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4099fa5f-fd5b-43b6-87a2-566ce59a396f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132892024-11-09T02:59:24.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4099fa5f-fd5b-43b6-87a2-566ce59a396f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132902024-11-09T02:59:25.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7fdd3288-7e3a-4c53-bc75-03243808a6d5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132912024-11-09T02:59:25.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7fdd3288-7e3a-4c53-bc75-03243808a6d5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132922024-11-09T02:59:25.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7fdd3288-7e3a-4c53-bc75-03243808a6d5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132932024-11-09T02:59:26.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c10aef03-2b3f-4f53-b2e8-e6c02839a491 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132942024-11-09T02:59:26.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c10aef03-2b3f-4f53-b2e8-e6c02839a491 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132952024-11-09T02:59:26.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c10aef03-2b3f-4f53-b2e8-e6c02839a491 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132962024-11-09T02:59:27.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ceda0583-afdf-4335-93ae-3b343db63d2e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132972024-11-09T02:59:27.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ceda0583-afdf-4335-93ae-3b343db63d2e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132982024-11-09T02:59:27.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ceda0583-afdf-4335-93ae-3b343db63d2e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
132992024-11-09T02:59:28.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 960de90a-40fe-4512-8dcb-f0afc0cba891 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133002024-11-09T02:59:28.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 960de90a-40fe-4512-8dcb-f0afc0cba891 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133012024-11-09T02:59:28.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 960de90a-40fe-4512-8dcb-f0afc0cba891 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133022024-11-09T02:59:29.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e329075c-e9e8-4381-aad0-2674417028e9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133032024-11-09T02:59:29.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e329075c-e9e8-4381-aad0-2674417028e9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133042024-11-09T02:59:29.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e329075c-e9e8-4381-aad0-2674417028e9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133052024-11-09T02:59:30.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1290 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 116277e6-0cfa-4392-acdf-b2cc4a6cc172 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
133062024-11-09T02:59:30.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0db0df75-c49e-4db2-a3da-a6c94177de1d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133072024-11-09T02:59:30.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0db0df75-c49e-4db2-a3da-a6c94177de1d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133082024-11-09T02:59:30.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0db0df75-c49e-4db2-a3da-a6c94177de1d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133092024-11-09T02:59:31.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3778eb33-a4c5-4ba5-bc2f-ab022af6c68c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133102024-11-09T02:59:31.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3778eb33-a4c5-4ba5-bc2f-ab022af6c68c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133112024-11-09T02:59:31.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3778eb33-a4c5-4ba5-bc2f-ab022af6c68c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133122024-11-09T02:59:32.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 872218a9-dc8b-43d6-ac5e-bba4ddcbdaf4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133132024-11-09T02:59:32.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 872218a9-dc8b-43d6-ac5e-bba4ddcbdaf4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133142024-11-09T02:59:32.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 872218a9-dc8b-43d6-ac5e-bba4ddcbdaf4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
133152024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
133162024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
133172024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
133182024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
133192024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133202024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
133212024-11-09T02:59:33.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
133222024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133232024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
133242024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133252024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
133262024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
133272024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
133282024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133292024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133302024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
133312024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133322024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
133332024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
133342024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
133352024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133362024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
133372024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
133382024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
133392024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133402024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
133412024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
133422024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
133432024-11-09T02:59:33.172ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
133442024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.811\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
133452024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
133462024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
133472024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
133482024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
133492024-11-09T02:59:33.172ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
133502024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
133512024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
133522024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
133532024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133542024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
133552024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
133562024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
133572024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133582024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
133592024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133602024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
133612024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133622024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
133632024-11-09T02:59:33.172ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:49:33.172496069 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
133642024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
133652024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
133662024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.291\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
133672024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
133682024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
133692024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.88\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
133702024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
133712024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
133722024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.88\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
133732024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
133742024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
133752024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
133762024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.44\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
133772024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
133782024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133792024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133802024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133812024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
133822024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133832024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133842024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133852024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133862024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
133872024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133882024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133892024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
133902024-11-09T02:59:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
133912024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133922024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133932024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
133942024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
133952024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
133962024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
133972024-11-09T02:59:33.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 508346114 } })
133982024-11-09T02:59:33.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 508351664 } })
133992024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
134002024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.396069ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
134012024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
134022024-11-09T02:59:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.358948ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
134032024-11-09T02:59:33.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134042024-11-09T02:59:33.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134052024-11-09T02:59:33.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134062024-11-09T02:59:33.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134072024-11-09T02:59:33.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
134082024-11-09T02:59:33.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134092024-11-09T02:59:33.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134102024-11-09T02:59:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
134112024-11-09T02:59:33.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134122024-11-09T02:59:33.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134132024-11-09T02:59:33.183ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.050238ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
134142024-11-09T02:59:33.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134152024-11-09T02:59:33.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134162024-11-09T02:59:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
134172024-11-09T02:59:33.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
134182024-11-09T02:59:33.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 521957335 } })
134192024-11-09T02:59:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
134202024-11-09T02:59:33.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
134212024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134222024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134232024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134242024-11-09T02:59:33.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134252024-11-09T02:59:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134262024-11-09T02:59:33.191ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134272024-11-09T02:59:33.191ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134282024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
134292024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
134302024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
134312024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
134322024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134332024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134342024-11-09T02:59:33.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134352024-11-09T02:59:33.197ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 532937252 } })
134362024-11-09T02:59:33.197ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.303333ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
134372024-11-09T02:59:33.198ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
134382024-11-09T02:59:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134392024-11-09T02:59:33.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134402024-11-09T02:59:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134412024-11-09T02:59:33.202ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:49:33.172496069 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
134422024-11-09T02:59:33.203ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.504211ms iteration = 14 status = {"expiration":"2024-11-09T02:49:33.172496069Z","pruned":[]}
134432024-11-09T02:59:33.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134442024-11-09T02:59:33.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134452024-11-09T02:59:33.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134462024-11-09T02:59:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134472024-11-09T02:59:33.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
134482024-11-09T02:59:33.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134492024-11-09T02:59:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134502024-11-09T02:59:33.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
134512024-11-09T02:59:33.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134522024-11-09T02:59:33.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134532024-11-09T02:59:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134542024-11-09T02:59:33.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134552024-11-09T02:59:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134562024-11-09T02:59:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
134572024-11-09T02:59:33.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134582024-11-09T02:59:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134592024-11-09T02:59:33.220ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
134602024-11-09T02:59:33.220ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
134612024-11-09T02:59:33.220ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
134622024-11-09T02:59:33.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134632024-11-09T02:59:33.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134642024-11-09T02:59:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134652024-11-09T02:59:33.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134662024-11-09T02:59:33.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134672024-11-09T02:59:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134682024-11-09T02:59:33.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134692024-11-09T02:59:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134702024-11-09T02:59:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
134712024-11-09T02:59:33.226ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134722024-11-09T02:59:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134732024-11-09T02:59:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
134742024-11-09T02:59:33.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134752024-11-09T02:59:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134762024-11-09T02:59:33.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134772024-11-09T02:59:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134782024-11-09T02:59:33.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134792024-11-09T02:59:33.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
134802024-11-09T02:59:33.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134812024-11-09T02:59:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134822024-11-09T02:59:33.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
134832024-11-09T02:59:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134842024-11-09T02:59:33.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.729372ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
134852024-11-09T02:59:33.243ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134862024-11-09T02:59:33.243ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
134872024-11-09T02:59:33.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134882024-11-09T02:59:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134892024-11-09T02:59:33.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134902024-11-09T02:59:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
134912024-11-09T02:59:33.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134922024-11-09T02:59:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134932024-11-09T02:59:33.256ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 591540583 } })
134942024-11-09T02:59:33.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
134952024-11-09T02:59:33.259ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134962024-11-09T02:59:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134972024-11-09T02:59:33.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.190073ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134982024-11-09T02:59:33.263ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
134992024-11-09T02:59:33.263ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
135002024-11-09T02:59:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.526181ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
135012024-11-09T02:59:33.268ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
135022024-11-09T02:59:33.268ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
135032024-11-09T02:59:33.268ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
135042024-11-09T02:59:33.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135052024-11-09T02:59:33.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135062024-11-09T02:59:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135072024-11-09T02:59:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135082024-11-09T02:59:33.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135092024-11-09T02:59:33.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135102024-11-09T02:59:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135112024-11-09T02:59:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
135122024-11-09T02:59:33.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135132024-11-09T02:59:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135142024-11-09T02:59:33.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135152024-11-09T02:59:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
135162024-11-09T02:59:33.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135172024-11-09T02:59:33.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135182024-11-09T02:59:33.283ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
135192024-11-09T02:59:33.283ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
135202024-11-09T02:59:33.283ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 111.590896ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
135212024-11-09T02:59:33.284ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.077767ms iteration = 27 status = 0
135222024-11-09T02:59:33.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135232024-11-09T02:59:33.288ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
135242024-11-09T02:59:33.288ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
135252024-11-09T02:59:33.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135262024-11-09T02:59:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135272024-11-09T02:59:33.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
135282024-11-09T02:59:33.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135292024-11-09T02:59:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135302024-11-09T02:59:33.291ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
135312024-11-09T02:59:33.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.409088ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
135322024-11-09T02:59:33.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
135332024-11-09T02:59:33.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135342024-11-09T02:59:33.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
135352024-11-09T02:59:33.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
135362024-11-09T02:59:33.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135372024-11-09T02:59:33.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135382024-11-09T02:59:33.300ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
135392024-11-09T02:59:33.300ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
135402024-11-09T02:59:33.300ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
135412024-11-09T02:59:33.300ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.761201ms iteration = 14 status = {"generation":1}
135422024-11-09T02:59:33.301ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135432024-11-09T02:59:33.301ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
135442024-11-09T02:59:33.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135452024-11-09T02:59:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135462024-11-09T02:59:33.303ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
135472024-11-09T02:59:33.303ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.365275ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
135482024-11-09T02:59:33.310ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
135492024-11-09T02:59:33.310ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.027602ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
135502024-11-09T02:59:33.312ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
135512024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
135522024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
135532024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135542024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135552024-11-09T02:59:33.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135562024-11-09T02:59:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
135572024-11-09T02:59:33.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135582024-11-09T02:59:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135592024-11-09T02:59:33.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135602024-11-09T02:59:33.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135612024-11-09T02:59:33.328ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
135622024-11-09T02:59:33.328ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
135632024-11-09T02:59:33.328ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
135642024-11-09T02:59:33.328ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 156.632847ms iteration = 14 status = {"generation":2}
135652024-11-09T02:59:33.341ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135662024-11-09T02:59:33.341ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
135672024-11-09T02:59:33.341ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.889161ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
135682024-11-09T02:59:33.363ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
135692024-11-09T02:59:33.363ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135702024-11-09T02:59:33.364ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbee2222-977c-48e4-a5ab-1796ea90f7ac", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
135712024-11-09T02:59:33.364ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135722024-11-09T02:59:33.365ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135732024-11-09T02:59:33.384ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.647944ms iteration = 30 status = {"physical_disks_added":0}
135742024-11-09T02:59:33.396ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
135752024-11-09T02:59:33.396ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 224.612301ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
135762024-11-09T02:59:33.434ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
135772024-11-09T02:59:33.435ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135782024-11-09T02:59:33.435ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b4fbcbc-f9dd-4fb1-b45e-5e309747bf13", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
135792024-11-09T02:59:33.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135802024-11-09T02:59:33.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
135812024-11-09T02:59:33.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135822024-11-09T02:59:33.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135832024-11-09T02:59:33.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135842024-11-09T02:59:33.469ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
135852024-11-09T02:59:33.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
135862024-11-09T02:59:33.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135872024-11-09T02:59:33.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135882024-11-09T02:59:33.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135892024-11-09T02:59:33.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
135902024-11-09T02:59:33.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135912024-11-09T02:59:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135922024-11-09T02:59:33.494ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
135932024-11-09T02:59:33.494ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135942024-11-09T02:59:33.494ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "31b3a4de-063c-4ad1-9209-735a1d6ea43f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
135952024-11-09T02:59:33.494ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135962024-11-09T02:59:33.496ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135972024-11-09T02:59:33.500ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
135982024-11-09T02:59:33.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f752f147-9ae4-4b44-b3ea-90e73aac51dd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
135992024-11-09T02:59:33.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f752f147-9ae4-4b44-b3ea-90e73aac51dd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136002024-11-09T02:59:33.685ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
136012024-11-09T02:59:33.685ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136022024-11-09T02:59:33.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f752f147-9ae4-4b44-b3ea-90e73aac51dd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136032024-11-09T02:59:33.691ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
136042024-11-09T02:59:33.691ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4e396bbb-c2d3-42e9-b436-e50c13b2b889", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136052024-11-09T02:59:33.691ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136062024-11-09T02:59:33.692ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "958c159b-5247-44cb-9842-6b4a62366248", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136072024-11-09T02:59:33.692ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136082024-11-09T02:59:33.694ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136092024-11-09T02:59:33.694ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 521.794283ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
136102024-11-09T02:59:33.697ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 525.095471ms iteration = 27 status = {}
136112024-11-09T02:59:33.700ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
136122024-11-09T02:59:33.701ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
136132024-11-09T02:59:33.702ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9185d5f1-515b-405a-b579-888c250ddc5d", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136142024-11-09T02:59:33.704ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136152024-11-09T02:59:33.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136162024-11-09T02:59:33.706ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 534.209689ms iteration = 27 status = null
136172024-11-09T02:59:33.762ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
136182024-11-09T02:59:33.762ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "18a9ae7d-97f3-45d6-b343-00ab95130edc", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136192024-11-09T02:59:33.762ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136202024-11-09T02:59:33.764ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c7aaf6b7-c90e-4eec-bdca-0197c1a2c5ac", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136212024-11-09T02:59:33.764ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136222024-11-09T02:59:33.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "acc7ba28-c453-4564-92f1-08966cac6433", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136232024-11-09T02:59:33.766ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136242024-11-09T02:59:33.769ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
136252024-11-09T02:59:33.769ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 596.848284ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
136262024-11-09T02:59:33.779ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9604fc45-6965-4dd6-a82b-695681f94aa8", "content-length": "372", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136272024-11-09T02:59:33.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136282024-11-09T02:59:33.779ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "380205f4-229c-434e-afc2-6ae42b88d885", "content-length": "691", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136292024-11-09T02:59:33.779ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
136302024-11-09T02:59:33.779ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
136312024-11-09T02:59:33.779ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
136322024-11-09T02:59:33.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136332024-11-09T02:59:33.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 609.838213ms iteration = 28 status = {}
136342024-11-09T02:59:33.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136352024-11-09T02:59:33.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136362024-11-09T02:59:33.818ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
136372024-11-09T02:59:33.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136382024-11-09T02:59:33.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136392024-11-09T02:59:33.819ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
136402024-11-09T02:59:33.819ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
136412024-11-09T02:59:33.820ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27f981fb-80c9-4527-9419-05f8c97528bd", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136422024-11-09T02:59:33.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136432024-11-09T02:59:33.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136442024-11-09T02:59:33.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136452024-11-09T02:59:33.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136462024-11-09T02:59:33.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136472024-11-09T02:59:33.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136482024-11-09T02:59:33.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
136492024-11-09T02:59:33.828ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cce73ae8-940b-41bd-bc45-359f17d7b58c", "content-length": "134", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136502024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
136512024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
136522024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
136532024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
136542024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136552024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136562024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136572024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
136582024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136592024-11-09T02:59:33.828ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
136602024-11-09T02:59:33.829ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
136612024-11-09T02:59:33.829ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136622024-11-09T02:59:33.829ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
136632024-11-09T02:59:33.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136642024-11-09T02:59:33.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136652024-11-09T02:59:33.831ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
136662024-11-09T02:59:33.831ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4409287-6d7d-45de-a398-08bd17dc1147", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136672024-11-09T02:59:33.831ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
136682024-11-09T02:59:33.831ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7cc04ac-a845-49d7-9eab-3d4fd5d1df9a", "content-length": "52", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136692024-11-09T02:59:33.831ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
136702024-11-09T02:59:33.831ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
136712024-11-09T02:59:33.833ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "50f435bc-0a68-4e6c-abea-105d0d13f6e7", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136722024-11-09T02:59:33.835ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 663.301677ms iteration = 28 status = {}
136732024-11-09T02:59:33.978ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "19d1d2b8-79e8-4185-a77b-d16643b1a75f", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136742024-11-09T02:59:33.978ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
136752024-11-09T02:59:33.978ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
136762024-11-09T02:59:33.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "142eeb4b-38d7-4472-8592-7562a02a8266", "content-length": "682", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
136772024-11-09T02:59:33.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136782024-11-09T02:59:33.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136792024-11-09T02:59:33.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136802024-11-09T02:59:33.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136812024-11-09T02:59:33.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136822024-11-09T02:59:33.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136832024-11-09T02:59:33.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136842024-11-09T02:59:33.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136852024-11-09T02:59:33.996ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 824.06968ms iteration = 27 status = {}
136862024-11-09T02:59:34.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 064f73ee-a87c-4404-99eb-d8bb41cf77dd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136872024-11-09T02:59:34.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 064f73ee-a87c-4404-99eb-d8bb41cf77dd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136882024-11-09T02:59:34.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 064f73ee-a87c-4404-99eb-d8bb41cf77dd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136892024-11-09T02:59:35.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = d76f17b3-ecdf-43f7-bbd7-9ececf889364 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
136902024-11-09T02:59:35.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = d76f17b3-ecdf-43f7-bbd7-9ececf889364 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
136912024-11-09T02:59:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = d76f17b3-ecdf-43f7-bbd7-9ececf889364 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
136922024-11-09T02:59:35.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = e63d768e-00c2-45c7-abfa-1e509df9a03f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
136932024-11-09T02:59:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = e63d768e-00c2-45c7-abfa-1e509df9a03f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
136942024-11-09T02:59:35.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = e63d768e-00c2-45c7-abfa-1e509df9a03f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
136952024-11-09T02:59:35.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3aca6808-7b39-4a83-a1ec-0110707c46ad roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136962024-11-09T02:59:35.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3aca6808-7b39-4a83-a1ec-0110707c46ad resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136972024-11-09T02:59:35.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3aca6808-7b39-4a83-a1ec-0110707c46ad response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136982024-11-09T02:59:36.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2e65945b-c193-413e-a0b0-beb95a920d2d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
136992024-11-09T02:59:36.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2e65945b-c193-413e-a0b0-beb95a920d2d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137002024-11-09T02:59:36.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2e65945b-c193-413e-a0b0-beb95a920d2d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137012024-11-09T02:59:37.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 42fd842a-3a29-40cb-88ff-54db04d92ba4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137022024-11-09T02:59:37.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 42fd842a-3a29-40cb-88ff-54db04d92ba4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137032024-11-09T02:59:37.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 42fd842a-3a29-40cb-88ff-54db04d92ba4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137042024-11-09T02:59:38.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f147061b-6451-4a1b-93f7-3beea6b2ad57 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137052024-11-09T02:59:38.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f147061b-6451-4a1b-93f7-3beea6b2ad57 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137062024-11-09T02:59:38.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f147061b-6451-4a1b-93f7-3beea6b2ad57 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137072024-11-09T02:59:39.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0fd89531-f6cf-4b0e-84d7-9a5496601cf9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137082024-11-09T02:59:39.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0fd89531-f6cf-4b0e-84d7-9a5496601cf9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137092024-11-09T02:59:39.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0fd89531-f6cf-4b0e-84d7-9a5496601cf9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137102024-11-09T02:59:40.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 59c71adc-710d-4edb-ba7b-d60010ab029b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137112024-11-09T02:59:40.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 59c71adc-710d-4edb-ba7b-d60010ab029b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137122024-11-09T02:59:40.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 59c71adc-710d-4edb-ba7b-d60010ab029b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137132024-11-09T02:59:41.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9c27cc2f-ab3d-4dd4-be00-76d52da4db62 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137142024-11-09T02:59:41.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9c27cc2f-ab3d-4dd4-be00-76d52da4db62 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137152024-11-09T02:59:41.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9c27cc2f-ab3d-4dd4-be00-76d52da4db62 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137162024-11-09T02:59:42.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df8d5b6f-6b39-4960-8b41-58988bcd40d5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137172024-11-09T02:59:42.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df8d5b6f-6b39-4960-8b41-58988bcd40d5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137182024-11-09T02:59:42.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = df8d5b6f-6b39-4960-8b41-58988bcd40d5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137192024-11-09T02:59:43.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
137202024-11-09T02:59:43.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
137212024-11-09T02:59:43.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137222024-11-09T02:59:43.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137232024-11-09T02:59:43.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137242024-11-09T02:59:43.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137252024-11-09T02:59:43.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137262024-11-09T02:59:43.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137272024-11-09T02:59:43.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137282024-11-09T02:59:43.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.214008ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137292024-11-09T02:59:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137302024-11-09T02:59:43.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137312024-11-09T02:59:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137322024-11-09T02:59:43.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137332024-11-09T02:59:43.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137342024-11-09T02:59:43.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137352024-11-09T02:59:43.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
137362024-11-09T02:59:43.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137372024-11-09T02:59:43.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137382024-11-09T02:59:43.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
137392024-11-09T02:59:43.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.613885ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
137402024-11-09T02:59:44.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9fe10eef-e31b-40f9-aeda-6909f1830490 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137412024-11-09T02:59:44.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9fe10eef-e31b-40f9-aeda-6909f1830490 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137422024-11-09T02:59:44.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9fe10eef-e31b-40f9-aeda-6909f1830490 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137432024-11-09T02:59:45.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12021fa3-5878-4eeb-85ce-fe56e83af166 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137442024-11-09T02:59:45.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12021fa3-5878-4eeb-85ce-fe56e83af166 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137452024-11-09T02:59:45.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 12021fa3-5878-4eeb-85ce-fe56e83af166 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137462024-11-09T02:59:45.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 629 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 34391d63-a30c-43b8-be30-6b860cf9f6ba response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
137472024-11-09T02:59:46.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff7188cb-a1c0-4bd4-806e-c01f0ef278da roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137482024-11-09T02:59:46.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff7188cb-a1c0-4bd4-806e-c01f0ef278da resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137492024-11-09T02:59:46.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ff7188cb-a1c0-4bd4-806e-c01f0ef278da response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137502024-11-09T02:59:47.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d294234-cde2-4c92-9069-19f31657412f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137512024-11-09T02:59:47.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d294234-cde2-4c92-9069-19f31657412f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137522024-11-09T02:59:47.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3d294234-cde2-4c92-9069-19f31657412f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137532024-11-09T02:59:48.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = afcbbde6-10b6-4580-b846-580ecda67310 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137542024-11-09T02:59:48.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = afcbbde6-10b6-4580-b846-580ecda67310 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137552024-11-09T02:59:48.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = afcbbde6-10b6-4580-b846-580ecda67310 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137562024-11-09T02:59:49.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7748ba5-5aa2-4ad6-855e-f8b0fb603551 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137572024-11-09T02:59:49.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7748ba5-5aa2-4ad6-855e-f8b0fb603551 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137582024-11-09T02:59:49.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7748ba5-5aa2-4ad6-855e-f8b0fb603551 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137592024-11-09T02:59:50.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = db26c8c6-2137-4323-b890-ac6ff8e5bd6a roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
137602024-11-09T02:59:50.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = db26c8c6-2137-4323-b890-ac6ff8e5bd6a resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
137612024-11-09T02:59:50.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = db26c8c6-2137-4323-b890-ac6ff8e5bd6a response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
137622024-11-09T02:59:50.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = b81a0b8e-bb6c-4640-9396-3fa15b00d080 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
137632024-11-09T02:59:50.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = b81a0b8e-bb6c-4640-9396-3fa15b00d080 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
137642024-11-09T02:59:50.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = b81a0b8e-bb6c-4640-9396-3fa15b00d080 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
137652024-11-09T02:59:50.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 528057a8-5490-4794-8b1d-cc65b908db9a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137662024-11-09T02:59:50.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 528057a8-5490-4794-8b1d-cc65b908db9a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137672024-11-09T02:59:50.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 528057a8-5490-4794-8b1d-cc65b908db9a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137682024-11-09T02:59:51.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 692cef18-922c-4226-8fc2-811728154a2e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137692024-11-09T02:59:51.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 692cef18-922c-4226-8fc2-811728154a2e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137702024-11-09T02:59:51.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 692cef18-922c-4226-8fc2-811728154a2e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137712024-11-09T02:59:52.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04dc5009-4fde-4e1b-aa9e-fb2e4ada434b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137722024-11-09T02:59:52.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04dc5009-4fde-4e1b-aa9e-fb2e4ada434b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137732024-11-09T02:59:52.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04dc5009-4fde-4e1b-aa9e-fb2e4ada434b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137742024-11-09T02:59:52.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 54312b15-8c37-49cb-8af3-86fe14d803f1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
137752024-11-09T02:59:52.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 54312b15-8c37-49cb-8af3-86fe14d803f1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
137762024-11-09T02:59:52.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 54312b15-8c37-49cb-8af3-86fe14d803f1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
137772024-11-09T02:59:53.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
137782024-11-09T02:59:53.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
137792024-11-09T02:59:53.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137802024-11-09T02:59:53.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137812024-11-09T02:59:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137822024-11-09T02:59:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137832024-11-09T02:59:53.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137842024-11-09T02:59:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137852024-11-09T02:59:53.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137862024-11-09T02:59:53.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.801649ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137872024-11-09T02:59:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137882024-11-09T02:59:53.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137892024-11-09T02:59:53.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137902024-11-09T02:59:53.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137912024-11-09T02:59:53.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137922024-11-09T02:59:53.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137932024-11-09T02:59:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
137942024-11-09T02:59:53.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137952024-11-09T02:59:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137962024-11-09T02:59:53.193ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
137972024-11-09T02:59:53.193ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.972864ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
137982024-11-09T02:59:53.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d15b799-f2b3-4881-8a00-5b024c51318a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
137992024-11-09T02:59:53.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d15b799-f2b3-4881-8a00-5b024c51318a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138002024-11-09T02:59:53.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0d15b799-f2b3-4881-8a00-5b024c51318a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138012024-11-09T02:59:54.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2fed12ba-5f3d-41fe-892f-8b76384e0470 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138022024-11-09T02:59:54.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2fed12ba-5f3d-41fe-892f-8b76384e0470 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138032024-11-09T02:59:54.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2fed12ba-5f3d-41fe-892f-8b76384e0470 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138042024-11-09T02:59:55.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0ccd5c97-cb95-4237-9c05-c3b1c08f8a31 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138052024-11-09T02:59:55.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0ccd5c97-cb95-4237-9c05-c3b1c08f8a31 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138062024-11-09T02:59:55.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0ccd5c97-cb95-4237-9c05-c3b1c08f8a31 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138072024-11-09T02:59:56.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a8058ea-6aec-44ec-9c8b-28bca8783fb1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138082024-11-09T02:59:56.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a8058ea-6aec-44ec-9c8b-28bca8783fb1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138092024-11-09T02:59:56.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8a8058ea-6aec-44ec-9c8b-28bca8783fb1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138102024-11-09T02:59:57.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fe9ff587-e13d-40c5-abdf-9f8a2b268e9d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138112024-11-09T02:59:57.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fe9ff587-e13d-40c5-abdf-9f8a2b268e9d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138122024-11-09T02:59:57.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fe9ff587-e13d-40c5-abdf-9f8a2b268e9d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138132024-11-09T02:59:58.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d55484bc-9b8c-4ea0-8897-9a4bff31167d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138142024-11-09T02:59:58.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d55484bc-9b8c-4ea0-8897-9a4bff31167d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138152024-11-09T02:59:58.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d55484bc-9b8c-4ea0-8897-9a4bff31167d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138162024-11-09T02:59:59.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9d2eb0f-f3ad-4ca8-9c86-09639ee9d9a7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138172024-11-09T02:59:59.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9d2eb0f-f3ad-4ca8-9c86-09639ee9d9a7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138182024-11-09T02:59:59.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f9d2eb0f-f3ad-4ca8-9c86-09639ee9d9a7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138192024-11-09T03:00:00.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 757 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 05d378eb-9064-47e3-96f3-c935ad4b022f response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
138202024-11-09T03:00:00.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 355b089e-505e-4680-8866-b500f7627c5a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138212024-11-09T03:00:00.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 355b089e-505e-4680-8866-b500f7627c5a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138222024-11-09T03:00:00.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 355b089e-505e-4680-8866-b500f7627c5a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138232024-11-09T03:00:01.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db0f0b47-0e6c-4668-9f62-c849e088e7b5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138242024-11-09T03:00:01.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db0f0b47-0e6c-4668-9f62-c849e088e7b5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138252024-11-09T03:00:01.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = db0f0b47-0e6c-4668-9f62-c849e088e7b5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138262024-11-09T03:00:02.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4d7c995-1806-4fe7-bbc4-cbd725bf32a1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138272024-11-09T03:00:02.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4d7c995-1806-4fe7-bbc4-cbd725bf32a1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138282024-11-09T03:00:02.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b4d7c995-1806-4fe7-bbc4-cbd725bf32a1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
138292024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
138302024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138312024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
138322024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138332024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
138342024-11-09T03:00:03.171ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
138352024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
138362024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
138372024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138382024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
138392024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
138402024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
138412024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138422024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
138432024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
138442024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138452024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
138462024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138472024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
138482024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138492024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
138502024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
138512024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138522024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
138532024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
138542024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
138552024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138562024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138572024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138582024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138592024-11-09T03:00:03.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138602024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138612024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
138622024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138632024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
138642024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138652024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138662024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138672024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138682024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
138692024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
138702024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.6\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
138712024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 15.991\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
138722024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
138732024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
138742024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
138752024-11-09T03:00:03.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.35\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
138762024-11-09T03:00:03.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138772024-11-09T03:00:03.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 512634213 } })
138782024-11-09T03:00:03.178ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
138792024-11-09T03:00:03.178ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138802024-11-09T03:00:03.178ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
138812024-11-09T03:00:03.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138822024-11-09T03:00:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138832024-11-09T03:00:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138842024-11-09T03:00:03.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138852024-11-09T03:00:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138862024-11-09T03:00:03.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138872024-11-09T03:00:03.180ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 515488832 } })
138882024-11-09T03:00:03.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138892024-11-09T03:00:03.180ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
138902024-11-09T03:00:03.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138912024-11-09T03:00:03.181ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.914045ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
138922024-11-09T03:00:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
138932024-11-09T03:00:03.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
138942024-11-09T03:00:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
138952024-11-09T03:00:03.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138962024-11-09T03:00:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
138972024-11-09T03:00:03.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138982024-11-09T03:00:03.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
138992024-11-09T03:00:03.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139002024-11-09T03:00:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139012024-11-09T03:00:03.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139022024-11-09T03:00:03.186ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
139032024-11-09T03:00:03.186ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
139042024-11-09T03:00:03.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
139052024-11-09T03:00:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139062024-11-09T03:00:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
139072024-11-09T03:00:03.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139082024-11-09T03:00:03.187ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139092024-11-09T03:00:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139102024-11-09T03:00:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139112024-11-09T03:00:03.188ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139122024-11-09T03:00:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139132024-11-09T03:00:03.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139142024-11-09T03:00:03.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139152024-11-09T03:00:03.191ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 526842686 } })
139162024-11-09T03:00:03.192ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
139172024-11-09T03:00:03.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
139182024-11-09T03:00:03.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139192024-11-09T03:00:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139202024-11-09T03:00:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
139212024-11-09T03:00:03.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139222024-11-09T03:00:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139232024-11-09T03:00:03.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
139242024-11-09T03:00:03.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
139252024-11-09T03:00:03.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139262024-11-09T03:00:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139272024-11-09T03:00:03.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139282024-11-09T03:00:03.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139292024-11-09T03:00:03.234ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
139302024-11-09T03:00:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.461061ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
139312024-11-09T03:00:03.236ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
139322024-11-09T03:00:03.236ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
139332024-11-09T03:00:03.236ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 65.058835ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
139342024-11-09T03:00:03.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139352024-11-09T03:00:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139362024-11-09T03:00:03.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139372024-11-09T03:00:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139382024-11-09T03:00:03.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.562914ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
139392024-11-09T03:00:03.271ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
139402024-11-09T03:00:03.271ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
139412024-11-09T03:00:03.272ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a90d6c-6349-4899-825b-33e1830f54ce", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
139422024-11-09T03:00:03.272ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
139432024-11-09T03:00:03.274ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
139442024-11-09T03:00:03.289ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
139452024-11-09T03:00:03.289ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
139462024-11-09T03:00:03.290ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2ecc39-2919-4adb-8b8b-fc4cdbacbd7a", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
139472024-11-09T03:00:03.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
139482024-11-09T03:00:03.292ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
139492024-11-09T03:00:03.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139502024-11-09T03:00:03.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139512024-11-09T03:00:03.303ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.843545ms iteration = 31 status = {"physical_disks_added":0}
139522024-11-09T03:00:03.304ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
139532024-11-09T03:00:03.304ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
139542024-11-09T03:00:03.304ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a2aef44-2150-4420-8035-02b586835622", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
139552024-11-09T03:00:03.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
139562024-11-09T03:00:03.305ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
139572024-11-09T03:00:03.305ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
139582024-11-09T03:00:03.305ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ae039d1-e3c3-4d34-bd94-72fa42592774", "content-length": "372", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
139592024-11-09T03:00:03.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139602024-11-09T03:00:03.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139612024-11-09T03:00:03.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
139622024-11-09T03:00:03.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139632024-11-09T03:00:03.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139642024-11-09T03:00:03.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139652024-11-09T03:00:03.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139662024-11-09T03:00:03.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139672024-11-09T03:00:03.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
139682024-11-09T03:00:03.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139692024-11-09T03:00:03.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139702024-11-09T03:00:03.315ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.536246ms iteration = 28 status = 0
139712024-11-09T03:00:03.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139722024-11-09T03:00:03.343ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 171.79851ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139732024-11-09T03:00:03.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
139742024-11-09T03:00:03.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139752024-11-09T03:00:03.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139762024-11-09T03:00:03.356ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
139772024-11-09T03:00:03.356ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
139782024-11-09T03:00:03.357ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
139792024-11-09T03:00:03.357ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 185.826011ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
139802024-11-09T03:00:03.364ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
139812024-11-09T03:00:03.364ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "665d8705-6b6d-4596-8afe-33966b036da1", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
139822024-11-09T03:00:03.365ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
139832024-11-09T03:00:03.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139842024-11-09T03:00:03.367ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 196.627623ms iteration = 28 status = null
139852024-11-09T03:00:03.378ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.026788ms iteration = 28 status = {}
139862024-11-09T03:00:03.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139872024-11-09T03:00:03.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139882024-11-09T03:00:03.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139892024-11-09T03:00:03.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
139902024-11-09T03:00:03.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139912024-11-09T03:00:03.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139922024-11-09T03:00:03.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139932024-11-09T03:00:03.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
139942024-11-09T03:00:03.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139952024-11-09T03:00:03.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139962024-11-09T03:00:03.443ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "573dc7ab-1579-4582-b84a-00b05edd7e18", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
139972024-11-09T03:00:03.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139982024-11-09T03:00:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139992024-11-09T03:00:03.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140002024-11-09T03:00:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140012024-11-09T03:00:03.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140022024-11-09T03:00:03.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140032024-11-09T03:00:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140042024-11-09T03:00:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140052024-11-09T03:00:03.451ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
140062024-11-09T03:00:03.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140072024-11-09T03:00:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140082024-11-09T03:00:03.452ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
140092024-11-09T03:00:03.452ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
140102024-11-09T03:00:03.453ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "307d8ba6-872e-4e8d-82be-ad01bd6c981c", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140112024-11-09T03:00:03.454ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.189532ms iteration = 29 status = {}
140122024-11-09T03:00:03.455ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
140132024-11-09T03:00:03.456ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c56a308-31ad-47c1-bd98-3287e9f72ae0", "content-length": "691", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140142024-11-09T03:00:03.456ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
140152024-11-09T03:00:03.456ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
140162024-11-09T03:00:03.456ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
140172024-11-09T03:00:03.457ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 286.142213ms iteration = 29 status = {}
140182024-11-09T03:00:03.470ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
140192024-11-09T03:00:03.470ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ac15869-6b76-45cc-a928-ef18f0881a18", "content-length": "134", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
140202024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
140212024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
140222024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
140232024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
140242024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
140252024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
140262024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
140272024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
140282024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
140292024-11-09T03:00:03.470ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
140302024-11-09T03:00:03.471ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
140312024-11-09T03:00:03.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140322024-11-09T03:00:03.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140332024-11-09T03:00:03.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
140342024-11-09T03:00:03.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad3e34b8-fab7-4a4f-9201-746bc3a4d9c9", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
140352024-11-09T03:00:03.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
140362024-11-09T03:00:03.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d38a2b28-bca7-4ac5-9cd9-6783c5e2d32a", "content-length": "52", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
140372024-11-09T03:00:03.473ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
140382024-11-09T03:00:03.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
140392024-11-09T03:00:03.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9963b204-54be-4f0f-b048-6f5a9baa1cc5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140402024-11-09T03:00:03.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9963b204-54be-4f0f-b048-6f5a9baa1cc5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140412024-11-09T03:00:03.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9963b204-54be-4f0f-b048-6f5a9baa1cc5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140422024-11-09T03:00:03.656ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9beb6414-6049-432d-8382-0a99b88d685b", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140432024-11-09T03:00:03.656ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
140442024-11-09T03:00:03.656ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
140452024-11-09T03:00:03.657ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "67651955-1fd7-4130-9822-3105d7a76dfb", "content-length": "682", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140462024-11-09T03:00:03.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140472024-11-09T03:00:03.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140482024-11-09T03:00:03.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140492024-11-09T03:00:03.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140502024-11-09T03:00:03.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140512024-11-09T03:00:03.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140522024-11-09T03:00:03.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140532024-11-09T03:00:03.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140542024-11-09T03:00:03.672ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.228258ms iteration = 28 status = {}
140552024-11-09T03:00:04.032ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
140562024-11-09T03:00:04.032ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
140572024-11-09T03:00:04.062ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
140582024-11-09T03:00:04.063ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:40609
140592024-11-09T03:00:04.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:40609 req_id = 68dfed94-498d-445d-b278-2d8317da54be roles = RoleSet { roles: {} } uri = /metrics/producers
140602024-11-09T03:00:04.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:40609 req_id = 68dfed94-498d-445d-b278-2d8317da54be resource = Database result = Ok(()) uri = /metrics/producers
140612024-11-09T03:00:04.099ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = c3da9028-2f6b-4199-8d06-98c01f75b9bf
140622024-11-09T03:00:04.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36639 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:40609 req_id = 68dfed94-498d-445d-b278-2d8317da54be response_code = 201 uri = /metrics/producers
140632024-11-09T03:00:04.099ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "68dfed94-498d-445d-b278-2d8317da54be", "content-length": "41", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140642024-11-09T03:00:04.102ZDEBGnexus (producer-registration-task): registered with nexus successfully
140652024-11-09T03:00:04.102ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
140662024-11-09T03:00:04.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d474ced4-eca9-4ddc-82f9-f6de321546e0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140672024-11-09T03:00:04.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d474ced4-eca9-4ddc-82f9-f6de321546e0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140682024-11-09T03:00:04.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d474ced4-eca9-4ddc-82f9-f6de321546e0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140692024-11-09T03:00:05.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 89102eab-2b36-48b3-9526-1e9f83d7735e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
140702024-11-09T03:00:05.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 89102eab-2b36-48b3-9526-1e9f83d7735e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
140712024-11-09T03:00:05.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 89102eab-2b36-48b3-9526-1e9f83d7735e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
140722024-11-09T03:00:05.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 604b3f9d-c1bb-434a-8aea-7b33bdad0fa4 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
140732024-11-09T03:00:05.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 604b3f9d-c1bb-434a-8aea-7b33bdad0fa4 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
140742024-11-09T03:00:05.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 604b3f9d-c1bb-434a-8aea-7b33bdad0fa4 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
140752024-11-09T03:00:05.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d0d9f9e-b41b-48b4-87dd-313d82b0a7f5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140762024-11-09T03:00:05.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d0d9f9e-b41b-48b4-87dd-313d82b0a7f5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140772024-11-09T03:00:05.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7d0d9f9e-b41b-48b4-87dd-313d82b0a7f5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140782024-11-09T03:00:06.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d78244db-3698-4b9a-999e-6c69cda021cb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140792024-11-09T03:00:06.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d78244db-3698-4b9a-999e-6c69cda021cb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140802024-11-09T03:00:06.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d78244db-3698-4b9a-999e-6c69cda021cb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140812024-11-09T03:00:07.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1c47d0a-142f-43a0-8b2b-b326f4621302 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140822024-11-09T03:00:07.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1c47d0a-142f-43a0-8b2b-b326f4621302 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140832024-11-09T03:00:07.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d1c47d0a-142f-43a0-8b2b-b326f4621302 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140842024-11-09T03:00:08.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e59e4135-8a17-4085-829f-c0c089b44977 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140852024-11-09T03:00:08.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e59e4135-8a17-4085-829f-c0c089b44977 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140862024-11-09T03:00:08.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e59e4135-8a17-4085-829f-c0c089b44977 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140872024-11-09T03:00:09.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33e72f07-8618-44f7-b6e8-4808de140db7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140882024-11-09T03:00:09.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33e72f07-8618-44f7-b6e8-4808de140db7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140892024-11-09T03:00:09.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 33e72f07-8618-44f7-b6e8-4808de140db7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140902024-11-09T03:00:10.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03fee950-41da-4dac-b3f3-d89fb2d1cf10 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140912024-11-09T03:00:10.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03fee950-41da-4dac-b3f3-d89fb2d1cf10 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140922024-11-09T03:00:10.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 03fee950-41da-4dac-b3f3-d89fb2d1cf10 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140932024-11-09T03:00:11.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b3f7d65-b141-4a0f-9086-9509521727a9 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140942024-11-09T03:00:11.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b3f7d65-b141-4a0f-9086-9509521727a9 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140952024-11-09T03:00:11.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4b3f7d65-b141-4a0f-9086-9509521727a9 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140962024-11-09T03:00:12.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98d73b87-3963-455b-86f7-aa9ada241552 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140972024-11-09T03:00:12.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98d73b87-3963-455b-86f7-aa9ada241552 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140982024-11-09T03:00:12.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 98d73b87-3963-455b-86f7-aa9ada241552 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
140992024-11-09T03:00:13.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
141002024-11-09T03:00:13.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
141012024-11-09T03:00:13.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141022024-11-09T03:00:13.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141032024-11-09T03:00:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141042024-11-09T03:00:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141052024-11-09T03:00:13.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141062024-11-09T03:00:13.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141072024-11-09T03:00:13.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141082024-11-09T03:00:13.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.282837ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
141092024-11-09T03:00:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141102024-11-09T03:00:13.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141112024-11-09T03:00:13.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141122024-11-09T03:00:13.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141132024-11-09T03:00:13.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141142024-11-09T03:00:13.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141152024-11-09T03:00:13.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
141162024-11-09T03:00:13.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141172024-11-09T03:00:13.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141182024-11-09T03:00:13.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
141192024-11-09T03:00:13.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.439042ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
141202024-11-09T03:00:13.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f16be635-f4f4-4783-ae69-2faba70d780e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141212024-11-09T03:00:13.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f16be635-f4f4-4783-ae69-2faba70d780e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141222024-11-09T03:00:13.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f16be635-f4f4-4783-ae69-2faba70d780e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141232024-11-09T03:00:14.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8734f347-9d16-4d02-a2f2-f56c7517d051 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141242024-11-09T03:00:14.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8734f347-9d16-4d02-a2f2-f56c7517d051 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141252024-11-09T03:00:14.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8734f347-9d16-4d02-a2f2-f56c7517d051 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141262024-11-09T03:00:15.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 874 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = aaa9dd51-acd0-4499-adbe-f81a331564b5 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
141272024-11-09T03:00:15.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43d8c5c7-d61b-4bb9-8cc6-d6bcf4338fc1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141282024-11-09T03:00:15.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43d8c5c7-d61b-4bb9-8cc6-d6bcf4338fc1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141292024-11-09T03:00:15.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 43d8c5c7-d61b-4bb9-8cc6-d6bcf4338fc1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141302024-11-09T03:00:16.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efeb85ed-354a-4976-80d5-4cd580d85d1c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141312024-11-09T03:00:16.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efeb85ed-354a-4976-80d5-4cd580d85d1c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141322024-11-09T03:00:16.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = efeb85ed-354a-4976-80d5-4cd580d85d1c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141332024-11-09T03:00:17.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28936a6d-6de5-46b3-9b43-6ac6d0f1c662 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141342024-11-09T03:00:17.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28936a6d-6de5-46b3-9b43-6ac6d0f1c662 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141352024-11-09T03:00:17.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28936a6d-6de5-46b3-9b43-6ac6d0f1c662 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141362024-11-09T03:00:18.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef5fb3b9-f323-4763-ac4f-c61268341fb7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141372024-11-09T03:00:18.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef5fb3b9-f323-4763-ac4f-c61268341fb7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141382024-11-09T03:00:18.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ef5fb3b9-f323-4763-ac4f-c61268341fb7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141392024-11-09T03:00:19.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 45cf0866-e93e-450c-917a-71192c6d800f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141402024-11-09T03:00:19.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 45cf0866-e93e-450c-917a-71192c6d800f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141412024-11-09T03:00:19.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 45cf0866-e93e-450c-917a-71192c6d800f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141422024-11-09T03:00:20.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f924cec-8b9e-48da-ae5f-d5ef69ff7c9b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141432024-11-09T03:00:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f924cec-8b9e-48da-ae5f-d5ef69ff7c9b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141442024-11-09T03:00:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f924cec-8b9e-48da-ae5f-d5ef69ff7c9b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141452024-11-09T03:00:21.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 86b7cd88-d9a2-4593-a55b-d45947d98f58 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141462024-11-09T03:00:21.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 86b7cd88-d9a2-4593-a55b-d45947d98f58 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141472024-11-09T03:00:21.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 86b7cd88-d9a2-4593-a55b-d45947d98f58 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141482024-11-09T03:00:22.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e6083c20-1da6-4d65-9f58-8bf6c6b6fa90 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
141492024-11-09T03:00:22.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e6083c20-1da6-4d65-9f58-8bf6c6b6fa90 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
141502024-11-09T03:00:22.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = e6083c20-1da6-4d65-9f58-8bf6c6b6fa90 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
141512024-11-09T03:00:22.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 255268e7-fb2d-4c86-b6ca-bdd03b56e009 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141522024-11-09T03:00:22.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 255268e7-fb2d-4c86-b6ca-bdd03b56e009 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141532024-11-09T03:00:22.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 255268e7-fb2d-4c86-b6ca-bdd03b56e009 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141542024-11-09T03:00:23.171ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
141552024-11-09T03:00:23.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
141562024-11-09T03:00:23.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141572024-11-09T03:00:23.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141582024-11-09T03:00:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141592024-11-09T03:00:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141602024-11-09T03:00:23.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141612024-11-09T03:00:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141622024-11-09T03:00:23.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141632024-11-09T03:00:23.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.40417ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
141642024-11-09T03:00:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141652024-11-09T03:00:23.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141662024-11-09T03:00:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141672024-11-09T03:00:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141682024-11-09T03:00:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141692024-11-09T03:00:23.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141702024-11-09T03:00:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
141712024-11-09T03:00:23.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141722024-11-09T03:00:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141732024-11-09T03:00:23.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
141742024-11-09T03:00:23.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.308649ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
141752024-11-09T03:00:23.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d64c9546-fe18-4a0f-b78a-df83bc990240 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141762024-11-09T03:00:23.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d64c9546-fe18-4a0f-b78a-df83bc990240 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141772024-11-09T03:00:23.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d64c9546-fe18-4a0f-b78a-df83bc990240 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141782024-11-09T03:00:24.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2744765a-203f-4214-8bce-574ad6c489f8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141792024-11-09T03:00:24.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2744765a-203f-4214-8bce-574ad6c489f8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141802024-11-09T03:00:24.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2744765a-203f-4214-8bce-574ad6c489f8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141812024-11-09T03:00:26.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6d65fba-9c97-4ba6-9d2b-73f16eacd942 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141822024-11-09T03:00:26.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6d65fba-9c97-4ba6-9d2b-73f16eacd942 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141832024-11-09T03:00:26.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6d65fba-9c97-4ba6-9d2b-73f16eacd942 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141842024-11-09T03:00:27.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e2bcd031-7eac-4665-9bc2-c0cba7871901 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141852024-11-09T03:00:27.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e2bcd031-7eac-4665-9bc2-c0cba7871901 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141862024-11-09T03:00:27.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e2bcd031-7eac-4665-9bc2-c0cba7871901 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141872024-11-09T03:00:28.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62782908-61ff-4c5b-9a54-3565fe55740c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141882024-11-09T03:00:28.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62782908-61ff-4c5b-9a54-3565fe55740c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141892024-11-09T03:00:28.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 62782908-61ff-4c5b-9a54-3565fe55740c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141902024-11-09T03:00:29.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 69664be9-81b0-438b-a9e4-7dd687df789d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141912024-11-09T03:00:29.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 69664be9-81b0-438b-a9e4-7dd687df789d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141922024-11-09T03:00:29.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 69664be9-81b0-438b-a9e4-7dd687df789d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141932024-11-09T03:00:30.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9cdf3dc3-d76b-4c3c-94f8-19f3dbc5d56c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141942024-11-09T03:00:30.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9cdf3dc3-d76b-4c3c-94f8-19f3dbc5d56c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141952024-11-09T03:00:30.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9cdf3dc3-d76b-4c3c-94f8-19f3dbc5d56c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141962024-11-09T03:00:30.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 662 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 10b7f245-100c-4209-8d39-3171d2f12bb6 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
141972024-11-09T03:00:31.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 67336b88-f1da-4f3e-a621-3a96930fc7a0 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141982024-11-09T03:00:31.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 67336b88-f1da-4f3e-a621-3a96930fc7a0 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
141992024-11-09T03:00:31.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 67336b88-f1da-4f3e-a621-3a96930fc7a0 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
142002024-11-09T03:00:32.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22ef69e1-c113-410a-a202-d39264b4583b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
142012024-11-09T03:00:32.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22ef69e1-c113-410a-a202-d39264b4583b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
142022024-11-09T03:00:32.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 22ef69e1-c113-410a-a202-d39264b4583b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
142032024-11-09T03:00:33.171ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
142042024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
142052024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
142062024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
142072024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142082024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
142092024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
142102024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
142112024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
142122024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
142132024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
142142024-11-09T03:00:33.172ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
142152024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
142162024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
142172024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
142182024-11-09T03:00:33.172ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:50:33.172070701 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
142192024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
142202024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
142212024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
142222024-11-09T03:00:33.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
142232024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142242024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
142252024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142262024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
142272024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142282024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
142292024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
142302024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
142312024-11-09T03:00:33.172ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
142322024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.96\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
142332024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
142342024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
142352024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
142362024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
142372024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
142382024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
142392024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142402024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
142412024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
142422024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
142432024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
142442024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142452024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
142462024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
142472024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
142482024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142492024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
142502024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142512024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
142522024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
142532024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
142542024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
142552024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
142562024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
142572024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
142582024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142592024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
142602024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
142612024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.701\u{b5}s iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
142622024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
142632024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
142642024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.3\u{b5}s iteration = 29 status = {"errors":[],"records_set_to_done":[]}
142652024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.97\u{b5}s iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
142662024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
142672024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
142682024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
142692024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
142702024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.171\u{b5}s iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
142712024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142722024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142732024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142742024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
142752024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
142762024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
142772024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
142782024-11-09T03:00:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142792024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
142802024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
142812024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142822024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142832024-11-09T03:00:33.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 507542107 } })
142842024-11-09T03:00:33.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 507578098 } })
142852024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
142862024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
142872024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
142882024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.297047ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
142892024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
142902024-11-09T03:00:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.102993ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
142912024-11-09T03:00:33.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
142922024-11-09T03:00:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
142932024-11-09T03:00:33.175ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142942024-11-09T03:00:33.176ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 510765254 } })
142952024-11-09T03:00:33.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
142962024-11-09T03:00:33.176ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:50:33.172070701 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
142972024-11-09T03:00:33.176ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.626686ms iteration = 15 status = {"expiration":"2024-11-09T02:50:33.172070701Z","pruned":[]}
142982024-11-09T03:00:33.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142992024-11-09T03:00:33.177ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.063285ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
143002024-11-09T03:00:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
143012024-11-09T03:00:33.178ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
143022024-11-09T03:00:33.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
143032024-11-09T03:00:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
143042024-11-09T03:00:33.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143052024-11-09T03:00:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143062024-11-09T03:00:33.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143072024-11-09T03:00:33.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143082024-11-09T03:00:33.181ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143092024-11-09T03:00:33.181ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
143102024-11-09T03:00:33.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143112024-11-09T03:00:33.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143122024-11-09T03:00:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
143132024-11-09T03:00:33.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
143142024-11-09T03:00:33.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143152024-11-09T03:00:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143162024-11-09T03:00:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
143172024-11-09T03:00:33.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143182024-11-09T03:00:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143192024-11-09T03:00:33.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143202024-11-09T03:00:33.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143212024-11-09T03:00:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143222024-11-09T03:00:33.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 521965835 } })
143232024-11-09T03:00:33.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143242024-11-09T03:00:33.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
143252024-11-09T03:00:33.187ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143262024-11-09T03:00:33.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143272024-11-09T03:00:33.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143282024-11-09T03:00:33.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143292024-11-09T03:00:33.189ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143302024-11-09T03:00:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143312024-11-09T03:00:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143322024-11-09T03:00:33.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143332024-11-09T03:00:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
143342024-11-09T03:00:33.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
143352024-11-09T03:00:33.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
143362024-11-09T03:00:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
143372024-11-09T03:00:33.192ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
143382024-11-09T03:00:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
143392024-11-09T03:00:33.193ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.886372ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
143402024-11-09T03:00:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
143412024-11-09T03:00:33.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143422024-11-09T03:00:33.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = af928e44-9902-4c85-a3bd-72a7bd796fe7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
143432024-11-09T03:00:33.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143442024-11-09T03:00:33.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = af928e44-9902-4c85-a3bd-72a7bd796fe7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
143452024-11-09T03:00:33.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143462024-11-09T03:00:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143472024-11-09T03:00:33.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143482024-11-09T03:00:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143492024-11-09T03:00:33.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143502024-11-09T03:00:33.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143512024-11-09T03:00:33.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.260298ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
143522024-11-09T03:00:33.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
143532024-11-09T03:00:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
143542024-11-09T03:00:33.206ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 541518550 } })
143552024-11-09T03:00:33.207ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
143562024-11-09T03:00:33.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143572024-11-09T03:00:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143582024-11-09T03:00:33.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143592024-11-09T03:00:33.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143602024-11-09T03:00:33.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143612024-11-09T03:00:33.211ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
143622024-11-09T03:00:33.211ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 38.968025ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
143632024-11-09T03:00:33.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
143642024-11-09T03:00:33.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = af928e44-9902-4c85-a3bd-72a7bd796fe7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
143652024-11-09T03:00:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143662024-11-09T03:00:33.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143672024-11-09T03:00:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
143682024-11-09T03:00:33.219ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143692024-11-09T03:00:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143702024-11-09T03:00:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
143712024-11-09T03:00:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143722024-11-09T03:00:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143732024-11-09T03:00:33.230ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
143742024-11-09T03:00:33.230ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.619412ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
143752024-11-09T03:00:33.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
143762024-11-09T03:00:33.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
143772024-11-09T03:00:33.238ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
143782024-11-09T03:00:33.238ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
143792024-11-09T03:00:33.238ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.749089ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
143802024-11-09T03:00:33.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143812024-11-09T03:00:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143822024-11-09T03:00:33.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143832024-11-09T03:00:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143842024-11-09T03:00:33.247ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
143852024-11-09T03:00:33.247ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
143862024-11-09T03:00:33.247ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.330357ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
143872024-11-09T03:00:33.248ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143882024-11-09T03:00:33.248ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
143892024-11-09T03:00:33.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143902024-11-09T03:00:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
143912024-11-09T03:00:33.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143922024-11-09T03:00:33.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
143932024-11-09T03:00:33.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143942024-11-09T03:00:33.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143952024-11-09T03:00:33.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143962024-11-09T03:00:33.262ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.530481ms iteration = 29 status = 0
143972024-11-09T03:00:33.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143982024-11-09T03:00:33.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143992024-11-09T03:00:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144002024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
144012024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144022024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144032024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144042024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144052024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
144062024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
144072024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
144082024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
144092024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
144102024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
144112024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144122024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144132024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144142024-11-09T03:00:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144152024-11-09T03:00:33.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
144162024-11-09T03:00:33.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144172024-11-09T03:00:33.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144182024-11-09T03:00:33.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
144192024-11-09T03:00:33.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
144202024-11-09T03:00:33.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.60116ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
144212024-11-09T03:00:33.297ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
144222024-11-09T03:00:33.308ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
144232024-11-09T03:00:33.308ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
144242024-11-09T03:00:33.308ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.879358ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
144252024-11-09T03:00:33.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
144262024-11-09T03:00:33.318ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 146.186742ms iteration = 32 status = {"physical_disks_added":0}
144272024-11-09T03:00:33.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144282024-11-09T03:00:33.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
144292024-11-09T03:00:33.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144302024-11-09T03:00:33.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144312024-11-09T03:00:33.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
144322024-11-09T03:00:33.329ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144332024-11-09T03:00:33.330ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05c4817a-80d5-446f-99e7-4074207bb897", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:32 GMT"} })
144342024-11-09T03:00:33.330ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144352024-11-09T03:00:33.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
144362024-11-09T03:00:33.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144372024-11-09T03:00:33.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144382024-11-09T03:00:33.398ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
144392024-11-09T03:00:33.398ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
144402024-11-09T03:00:33.398ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a29d5bb-2108-4beb-9f41-da391a19febc", "content-length": "372", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
144412024-11-09T03:00:33.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144422024-11-09T03:00:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144432024-11-09T03:00:33.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144442024-11-09T03:00:33.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144452024-11-09T03:00:33.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
144462024-11-09T03:00:33.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144472024-11-09T03:00:33.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144482024-11-09T03:00:33.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
144492024-11-09T03:00:33.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144502024-11-09T03:00:33.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144512024-11-09T03:00:33.436ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
144522024-11-09T03:00:33.436ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
144532024-11-09T03:00:33.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144542024-11-09T03:00:33.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144552024-11-09T03:00:33.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144562024-11-09T03:00:33.437ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
144572024-11-09T03:00:33.437ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
144582024-11-09T03:00:33.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144592024-11-09T03:00:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144602024-11-09T03:00:33.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144612024-11-09T03:00:33.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144622024-11-09T03:00:33.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
144632024-11-09T03:00:33.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144642024-11-09T03:00:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144652024-11-09T03:00:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
144662024-11-09T03:00:33.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144672024-11-09T03:00:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144682024-11-09T03:00:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
144692024-11-09T03:00:33.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144702024-11-09T03:00:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144712024-11-09T03:00:33.444ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
144722024-11-09T03:00:33.444ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
144732024-11-09T03:00:33.444ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
144742024-11-09T03:00:33.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 272.319257ms iteration = 15 status = {"generation":1}
144752024-11-09T03:00:33.445ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
144762024-11-09T03:00:33.445ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
144772024-11-09T03:00:33.445ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
144782024-11-09T03:00:33.445ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 273.099173ms iteration = 15 status = {"generation":2}
144792024-11-09T03:00:33.448ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
144802024-11-09T03:00:33.448ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 275.922072ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
144812024-11-09T03:00:33.449ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
144822024-11-09T03:00:33.449ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
144832024-11-09T03:00:33.449ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fcec1b8a-3ccf-4093-8d35-93b701e7a644", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
144842024-11-09T03:00:33.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144852024-11-09T03:00:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144862024-11-09T03:00:33.465ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
144872024-11-09T03:00:33.465ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144882024-11-09T03:00:33.465ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26c03a56-c7b8-4585-baae-32758d395b62", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
144892024-11-09T03:00:33.465ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144902024-11-09T03:00:33.467ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
144912024-11-09T03:00:33.467ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
144922024-11-09T03:00:33.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "768b19b3-73a7-4c7a-a5a4-4624c12c662f", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
144932024-11-09T03:00:33.468ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
144942024-11-09T03:00:33.469ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "82c3e7b8-b1fa-4fb4-9f5e-559cf18cece6", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
144952024-11-09T03:00:33.469ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
144962024-11-09T03:00:33.471ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
144972024-11-09T03:00:33.471ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 299.193253ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
144982024-11-09T03:00:33.479ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
144992024-11-09T03:00:33.479ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
145002024-11-09T03:00:33.479ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d88394-4fb5-41d0-b276-f169184441f2", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145012024-11-09T03:00:33.479ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
145022024-11-09T03:00:33.481ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
145032024-11-09T03:00:33.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
145042024-11-09T03:00:33.500ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
145052024-11-09T03:00:33.500ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 327.900646ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
145062024-11-09T03:00:33.502ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 330.774515ms iteration = 29 status = {}
145072024-11-09T03:00:33.554ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
145082024-11-09T03:00:33.554ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7df0b4c7-99c6-497e-9c72-994b27275913", "content-length": "691", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145092024-11-09T03:00:33.554ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
145102024-11-09T03:00:33.554ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
145112024-11-09T03:00:33.554ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
145122024-11-09T03:00:33.555ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 383.974905ms iteration = 30 status = {}
145132024-11-09T03:00:33.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145142024-11-09T03:00:33.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145152024-11-09T03:00:33.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145162024-11-09T03:00:33.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145172024-11-09T03:00:33.562ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
145182024-11-09T03:00:33.562ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
145192024-11-09T03:00:33.562ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7a61347f-c73d-4e56-9437-630fb1e27e82", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145202024-11-09T03:00:33.563ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
145212024-11-09T03:00:33.563ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "69fd32c7-19b8-4846-94e5-71fd6862ce5e", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145222024-11-09T03:00:33.564ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 392.711626ms iteration = 30 status = {}
145232024-11-09T03:00:33.565ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
145242024-11-09T03:00:33.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
145252024-11-09T03:00:33.567ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 395.482143ms iteration = 29 status = null
145262024-11-09T03:00:33.569ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
145272024-11-09T03:00:33.569ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d0617aa8-2e55-4889-9dc9-e17b77a25e4d", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145282024-11-09T03:00:33.569ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145292024-11-09T03:00:33.571ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bc02adfe-57bb-4136-a6e3-822281bc1293", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145302024-11-09T03:00:33.571ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145312024-11-09T03:00:33.572ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8c6f0815-047f-4919-bd85-8722dab95bee", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145322024-11-09T03:00:33.572ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145332024-11-09T03:00:33.574ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145342024-11-09T03:00:33.574ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 401.885425ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
145352024-11-09T03:00:33.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145362024-11-09T03:00:33.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145372024-11-09T03:00:33.631ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
145382024-11-09T03:00:33.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145392024-11-09T03:00:33.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145402024-11-09T03:00:33.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
145412024-11-09T03:00:33.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2076323e-7eb7-4d4b-9a5a-f9775ebb9b07", "content-length": "134", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145422024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
145432024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
145442024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
145452024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
145462024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145472024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145482024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145492024-11-09T03:00:33.641ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
145502024-11-09T03:00:33.642ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145512024-11-09T03:00:33.642ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
145522024-11-09T03:00:33.642ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
145532024-11-09T03:00:33.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145542024-11-09T03:00:33.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145552024-11-09T03:00:33.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
145562024-11-09T03:00:33.643ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca4b76a2-c65f-4a73-8d26-04fe15bee8fe", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145572024-11-09T03:00:33.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
145582024-11-09T03:00:33.643ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1dd8c61-3e7c-42b2-a30e-1bfe2eff8302", "content-length": "52", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145592024-11-09T03:00:33.643ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
145602024-11-09T03:00:33.643ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
145612024-11-09T03:00:33.781ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6c552a71-ff0b-417d-b06f-0dfb80d56e63", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145622024-11-09T03:00:33.781ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
145632024-11-09T03:00:33.781ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
145642024-11-09T03:00:33.786ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed3f068d-9e5b-4fe0-a4b6-b9cbd40d8894", "content-length": "682", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145652024-11-09T03:00:33.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145662024-11-09T03:00:33.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145672024-11-09T03:00:33.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145682024-11-09T03:00:33.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145692024-11-09T03:00:33.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145702024-11-09T03:00:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145712024-11-09T03:00:33.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145722024-11-09T03:00:33.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145732024-11-09T03:00:33.802ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 630.144092ms iteration = 29 status = {}
145742024-11-09T03:00:34.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b08b1b0-8ed8-4bd9-81bc-f936ba4c3be5 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145752024-11-09T03:00:34.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b08b1b0-8ed8-4bd9-81bc-f936ba4c3be5 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145762024-11-09T03:00:34.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9b08b1b0-8ed8-4bd9-81bc-f936ba4c3be5 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145772024-11-09T03:00:35.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 27c1218e-a9a8-4128-b852-3ff155db37d1 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
145782024-11-09T03:00:35.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 27c1218e-a9a8-4128-b852-3ff155db37d1 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
145792024-11-09T03:00:35.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 27c1218e-a9a8-4128-b852-3ff155db37d1 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
145802024-11-09T03:00:35.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 433c4062-9f85-4df2-88a3-d1fcc2c44906 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
145812024-11-09T03:00:35.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 433c4062-9f85-4df2-88a3-d1fcc2c44906 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
145822024-11-09T03:00:35.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 433c4062-9f85-4df2-88a3-d1fcc2c44906 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
145832024-11-09T03:00:35.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3d3e818-99c5-43da-ac9d-c4aed59b5447 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145842024-11-09T03:00:35.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3d3e818-99c5-43da-ac9d-c4aed59b5447 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145852024-11-09T03:00:35.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c3d3e818-99c5-43da-ac9d-c4aed59b5447 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145862024-11-09T03:00:36.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fd48fbda-c8b7-4389-8f41-409c05bad6e7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145872024-11-09T03:00:36.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fd48fbda-c8b7-4389-8f41-409c05bad6e7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145882024-11-09T03:00:36.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = fd48fbda-c8b7-4389-8f41-409c05bad6e7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145892024-11-09T03:00:37.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaccf999-a472-41c8-b962-82762f553290 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145902024-11-09T03:00:37.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaccf999-a472-41c8-b962-82762f553290 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145912024-11-09T03:00:37.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = eaccf999-a472-41c8-b962-82762f553290 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145922024-11-09T03:00:38.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3deaa96a-ad17-44c9-a674-23f3291097ae roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145932024-11-09T03:00:38.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3deaa96a-ad17-44c9-a674-23f3291097ae resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145942024-11-09T03:00:38.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3deaa96a-ad17-44c9-a674-23f3291097ae response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145952024-11-09T03:00:39.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d20420e-d184-4054-88c9-9fb406c377cb roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145962024-11-09T03:00:39.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d20420e-d184-4054-88c9-9fb406c377cb resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145972024-11-09T03:00:39.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d20420e-d184-4054-88c9-9fb406c377cb response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145982024-11-09T03:00:40.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dcc5270a-782b-42fb-b4ae-a7ee19ab5c4e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
145992024-11-09T03:00:40.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dcc5270a-782b-42fb-b4ae-a7ee19ab5c4e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146002024-11-09T03:00:40.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = dcc5270a-782b-42fb-b4ae-a7ee19ab5c4e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146012024-11-09T03:00:41.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 319e0cac-7d9a-40c4-8d00-78603089b699 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146022024-11-09T03:00:41.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 319e0cac-7d9a-40c4-8d00-78603089b699 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146032024-11-09T03:00:41.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 319e0cac-7d9a-40c4-8d00-78603089b699 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146042024-11-09T03:00:42.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c54b2c38-8664-4340-88bb-1b8ada18f48a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146052024-11-09T03:00:42.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c54b2c38-8664-4340-88bb-1b8ada18f48a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146062024-11-09T03:00:42.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c54b2c38-8664-4340-88bb-1b8ada18f48a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146072024-11-09T03:00:43.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
146082024-11-09T03:00:43.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
146092024-11-09T03:00:43.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146102024-11-09T03:00:43.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146112024-11-09T03:00:43.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146122024-11-09T03:00:43.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146132024-11-09T03:00:43.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146142024-11-09T03:00:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
146152024-11-09T03:00:43.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146162024-11-09T03:00:43.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146172024-11-09T03:00:43.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146182024-11-09T03:00:43.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146192024-11-09T03:00:43.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146202024-11-09T03:00:43.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
146212024-11-09T03:00:43.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146222024-11-09T03:00:43.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146232024-11-09T03:00:43.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
146242024-11-09T03:00:43.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.000592ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
146252024-11-09T03:00:43.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146262024-11-09T03:00:43.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146272024-11-09T03:00:43.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.649275ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146282024-11-09T03:00:43.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d719f54-c621-4dda-8113-eae8932b14c3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146292024-11-09T03:00:43.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d719f54-c621-4dda-8113-eae8932b14c3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146302024-11-09T03:00:43.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8d719f54-c621-4dda-8113-eae8932b14c3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146312024-11-09T03:00:44.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 548f52ce-a94b-40fc-9e27-737071083d2d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146322024-11-09T03:00:44.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 548f52ce-a94b-40fc-9e27-737071083d2d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146332024-11-09T03:00:44.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 548f52ce-a94b-40fc-9e27-737071083d2d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146342024-11-09T03:00:45.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 843 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 98454237-63ff-4f3d-afa7-bd7cdeed9c33 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
146352024-11-09T03:00:45.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0b99d865-9d09-436a-bc4f-d64166b97264 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146362024-11-09T03:00:45.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0b99d865-9d09-436a-bc4f-d64166b97264 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146372024-11-09T03:00:45.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 0b99d865-9d09-436a-bc4f-d64166b97264 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146382024-11-09T03:00:46.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9559d6fd-8a58-46cf-9ce9-85e0f6eb8ca6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146392024-11-09T03:00:46.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9559d6fd-8a58-46cf-9ce9-85e0f6eb8ca6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146402024-11-09T03:00:46.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 9559d6fd-8a58-46cf-9ce9-85e0f6eb8ca6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146412024-11-09T03:00:47.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2808da8-9e05-4ada-bb30-3598ead71832 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146422024-11-09T03:00:47.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2808da8-9e05-4ada-bb30-3598ead71832 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146432024-11-09T03:00:47.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = d2808da8-9e05-4ada-bb30-3598ead71832 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146442024-11-09T03:00:48.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 418c26d9-d7e7-46e7-ad5c-cae06d76ed0c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146452024-11-09T03:00:48.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 418c26d9-d7e7-46e7-ad5c-cae06d76ed0c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146462024-11-09T03:00:48.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 418c26d9-d7e7-46e7-ad5c-cae06d76ed0c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146472024-11-09T03:00:49.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d8b3a31-33de-4574-ab89-8fce96754ba1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146482024-11-09T03:00:49.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d8b3a31-33de-4574-ab89-8fce96754ba1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146492024-11-09T03:00:49.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2d8b3a31-33de-4574-ab89-8fce96754ba1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146502024-11-09T03:00:50.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = aa909449-b9e8-4607-91fe-73759ea47d05 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
146512024-11-09T03:00:50.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = aa909449-b9e8-4607-91fe-73759ea47d05 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
146522024-11-09T03:00:50.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = aa909449-b9e8-4607-91fe-73759ea47d05 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
146532024-11-09T03:00:50.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 70ffec72-d0f8-42d5-9257-51b4969e6347 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
146542024-11-09T03:00:50.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 70ffec72-d0f8-42d5-9257-51b4969e6347 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
146552024-11-09T03:00:50.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 70ffec72-d0f8-42d5-9257-51b4969e6347 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
146562024-11-09T03:00:50.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4035d78f-74ca-45e5-91c4-4e79bc49a4b6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146572024-11-09T03:00:50.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4035d78f-74ca-45e5-91c4-4e79bc49a4b6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146582024-11-09T03:00:50.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4035d78f-74ca-45e5-91c4-4e79bc49a4b6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146592024-11-09T03:00:51.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79f35f07-29be-418a-b980-0b4ee744d06e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146602024-11-09T03:00:51.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79f35f07-29be-418a-b980-0b4ee744d06e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146612024-11-09T03:00:51.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 79f35f07-29be-418a-b980-0b4ee744d06e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146622024-11-09T03:00:52.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = b3aa6536-934e-499e-af96-856ecac34747 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
146632024-11-09T03:00:52.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = b3aa6536-934e-499e-af96-856ecac34747 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
146642024-11-09T03:00:52.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = b3aa6536-934e-499e-af96-856ecac34747 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
146652024-11-09T03:00:52.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f98d3deb-6ffd-491f-8cb5-ce656b4cd72d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146662024-11-09T03:00:52.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f98d3deb-6ffd-491f-8cb5-ce656b4cd72d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146672024-11-09T03:00:52.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f98d3deb-6ffd-491f-8cb5-ce656b4cd72d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146682024-11-09T03:00:53.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
146692024-11-09T03:00:53.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
146702024-11-09T03:00:53.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146712024-11-09T03:00:53.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146722024-11-09T03:00:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146732024-11-09T03:00:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146742024-11-09T03:00:53.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146752024-11-09T03:00:53.175ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146762024-11-09T03:00:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146772024-11-09T03:00:53.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
146782024-11-09T03:00:53.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146792024-11-09T03:00:53.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146802024-11-09T03:00:53.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146812024-11-09T03:00:53.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146822024-11-09T03:00:53.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146832024-11-09T03:00:53.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
146842024-11-09T03:00:53.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146852024-11-09T03:00:53.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146862024-11-09T03:00:53.190ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
146872024-11-09T03:00:53.190ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.272378ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
146882024-11-09T03:00:53.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.600503ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146892024-11-09T03:00:53.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2a73a341-bf4f-40f2-9fce-b49968dbdf0d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146902024-11-09T03:00:53.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2a73a341-bf4f-40f2-9fce-b49968dbdf0d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146912024-11-09T03:00:53.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2a73a341-bf4f-40f2-9fce-b49968dbdf0d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146922024-11-09T03:00:54.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b44efdc8-d835-44b4-a3e4-10ddc5f04afd roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146932024-11-09T03:00:54.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b44efdc8-d835-44b4-a3e4-10ddc5f04afd resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146942024-11-09T03:00:54.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b44efdc8-d835-44b4-a3e4-10ddc5f04afd response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146952024-11-09T03:00:55.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6cb9f1a-ac72-4a69-9d9a-4c783025f945 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146962024-11-09T03:00:55.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6cb9f1a-ac72-4a69-9d9a-4c783025f945 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146972024-11-09T03:00:55.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e6cb9f1a-ac72-4a69-9d9a-4c783025f945 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146982024-11-09T03:00:56.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1618712d-81aa-4fdb-bde8-785be9e1f30b roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
146992024-11-09T03:00:56.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1618712d-81aa-4fdb-bde8-785be9e1f30b resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147002024-11-09T03:00:56.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1618712d-81aa-4fdb-bde8-785be9e1f30b response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147012024-11-09T03:00:57.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4d580bd8-ce14-44ae-b281-702402f8f64f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147022024-11-09T03:00:57.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4d580bd8-ce14-44ae-b281-702402f8f64f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147032024-11-09T03:00:57.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4d580bd8-ce14-44ae-b281-702402f8f64f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147042024-11-09T03:00:58.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8614dc5f-b9e3-4d56-91db-28fedebd3ae7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147052024-11-09T03:00:58.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8614dc5f-b9e3-4d56-91db-28fedebd3ae7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147062024-11-09T03:00:58.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8614dc5f-b9e3-4d56-91db-28fedebd3ae7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147072024-11-09T03:00:59.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76dde108-fe0d-465e-87dd-572c3d4b9e76 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147082024-11-09T03:00:59.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76dde108-fe0d-465e-87dd-572c3d4b9e76 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147092024-11-09T03:00:59.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 76dde108-fe0d-465e-87dd-572c3d4b9e76 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147102024-11-09T03:01:00.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 904 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = 1076076a-5b1f-43d2-9366-c4fd2841b227 response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
147112024-11-09T03:01:00.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 076ec974-a3e5-4942-8eae-d8d59d9e94e1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147122024-11-09T03:01:00.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 076ec974-a3e5-4942-8eae-d8d59d9e94e1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147132024-11-09T03:01:00.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 076ec974-a3e5-4942-8eae-d8d59d9e94e1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147142024-11-09T03:01:01.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ffeec75-e68c-4a36-9774-d55bd682ebf2 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147152024-11-09T03:01:01.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ffeec75-e68c-4a36-9774-d55bd682ebf2 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147162024-11-09T03:01:01.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7ffeec75-e68c-4a36-9774-d55bd682ebf2 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147172024-11-09T03:01:02.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac760f8c-9d6f-4b8b-a3d5-95d22d325cf3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147182024-11-09T03:01:02.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac760f8c-9d6f-4b8b-a3d5-95d22d325cf3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147192024-11-09T03:01:02.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = ac760f8c-9d6f-4b8b-a3d5-95d22d325cf3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
147202024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
147212024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
147222024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
147232024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
147242024-11-09T03:01:03.172ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
147252024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147262024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
147272024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147282024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147292024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
147302024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
147312024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
147322024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147332024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
147342024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
147352024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
147362024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147372024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
147382024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
147392024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
147402024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
147412024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
147422024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
147432024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
147442024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
147452024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147462024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147472024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147482024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
147492024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147502024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
147512024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147522024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
147532024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147542024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
147552024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147562024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147572024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
147582024-11-09T03:01:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147592024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
147602024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
147612024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.32\u{b5}s iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
147622024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
147632024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.231\u{b5}s iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
147642024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
147652024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.23\u{b5}s iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
147662024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6\u{b5}s iteration = 30 status = {"errors":[],"records_set_to_done":[]}
147672024-11-09T03:01:03.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147682024-11-09T03:01:03.175ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 510182232 } })
147692024-11-09T03:01:03.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147702024-11-09T03:01:03.176ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
147712024-11-09T03:01:03.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147722024-11-09T03:01:03.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147732024-11-09T03:01:03.176ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.294839ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
147742024-11-09T03:01:03.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147752024-11-09T03:01:03.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147762024-11-09T03:01:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147772024-11-09T03:01:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
147782024-11-09T03:01:03.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147792024-11-09T03:01:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147802024-11-09T03:01:03.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147812024-11-09T03:01:03.180ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147822024-11-09T03:01:03.180ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
147832024-11-09T03:01:03.180ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
147842024-11-09T03:01:03.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
147852024-11-09T03:01:03.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147862024-11-09T03:01:03.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 516768558 } })
147872024-11-09T03:01:03.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
147882024-11-09T03:01:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
147892024-11-09T03:01:03.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147902024-11-09T03:01:03.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147912024-11-09T03:01:03.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147922024-11-09T03:01:03.186ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147932024-11-09T03:01:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147942024-11-09T03:01:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147952024-11-09T03:01:03.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147962024-11-09T03:01:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147972024-11-09T03:01:03.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147982024-11-09T03:01:03.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147992024-11-09T03:01:03.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148002024-11-09T03:01:03.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148012024-11-09T03:01:03.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148022024-11-09T03:01:03.189ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
148032024-11-09T03:01:03.189ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
148042024-11-09T03:01:03.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
148052024-11-09T03:01:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148062024-11-09T03:01:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
148072024-11-09T03:01:03.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148082024-11-09T03:01:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148092024-11-09T03:01:03.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148102024-11-09T03:01:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
148112024-11-09T03:01:03.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
148122024-11-09T03:01:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
148132024-11-09T03:01:03.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148142024-11-09T03:01:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148152024-11-09T03:01:03.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
148162024-11-09T03:01:03.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148172024-11-09T03:01:03.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148182024-11-09T03:01:03.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
148192024-11-09T03:01:03.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
148202024-11-09T03:01:03.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148212024-11-09T03:01:03.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.947086ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
148222024-11-09T03:01:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
148232024-11-09T03:01:03.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
148242024-11-09T03:01:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
148252024-11-09T03:01:03.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148262024-11-09T03:01:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148272024-11-09T03:01:03.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148282024-11-09T03:01:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
148292024-11-09T03:01:03.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148302024-11-09T03:01:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148312024-11-09T03:01:03.228ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
148322024-11-09T03:01:03.228ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
148332024-11-09T03:01:03.228ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 56.63536ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
148342024-11-09T03:01:03.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
148352024-11-09T03:01:03.248ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
148362024-11-09T03:01:03.248ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "24d79631-703a-40d6-9c84-6321fa137775", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148372024-11-09T03:01:03.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
148382024-11-09T03:01:03.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
148392024-11-09T03:01:03.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
148402024-11-09T03:01:03.256ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
148412024-11-09T03:01:03.256ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf79d4bd-b1a3-47ea-8ccc-9ecc774cbaef", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148422024-11-09T03:01:03.256ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
148432024-11-09T03:01:03.258ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
148442024-11-09T03:01:03.268ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
148452024-11-09T03:01:03.268ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
148462024-11-09T03:01:03.268ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce154ff6-6884-4edb-917b-63553882144a", "content-length": "372", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148472024-11-09T03:01:03.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148482024-11-09T03:01:03.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148492024-11-09T03:01:03.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148502024-11-09T03:01:03.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148512024-11-09T03:01:03.274ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 608515914 } })
148522024-11-09T03:01:03.274ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
148532024-11-09T03:01:03.283ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
148542024-11-09T03:01:03.283ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.698209ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
148552024-11-09T03:01:03.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148562024-11-09T03:01:03.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
148572024-11-09T03:01:03.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148582024-11-09T03:01:03.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148592024-11-09T03:01:03.314ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
148602024-11-09T03:01:03.314ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 141.998215ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
148612024-11-09T03:01:03.315ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.776351ms iteration = 30 status = 0
148622024-11-09T03:01:03.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 149.467259ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
148632024-11-09T03:01:03.322ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
148642024-11-09T03:01:03.322ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
148652024-11-09T03:01:03.346ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
148662024-11-09T03:01:03.346ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "54625607-3966-4b49-bb21-42d7dc941e97", "content-length": "2", "date": "Sat, 09 Nov 2024 03:01:02 GMT"} })
148672024-11-09T03:01:03.348ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
148682024-11-09T03:01:03.349ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 176.843275ms iteration = 30 status = {}
148692024-11-09T03:01:03.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
148702024-11-09T03:01:03.351ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.102861ms iteration = 30 status = null
148712024-11-09T03:01:03.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
148722024-11-09T03:01:03.355ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
148732024-11-09T03:01:03.355ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b95d848-5f0e-47de-ba8e-30396acc696f", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148742024-11-09T03:01:03.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
148752024-11-09T03:01:03.356ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
148762024-11-09T03:01:03.371ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.916781ms iteration = 33 status = {"physical_disks_added":0}
148772024-11-09T03:01:03.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148782024-11-09T03:01:03.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148792024-11-09T03:01:03.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148802024-11-09T03:01:03.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
148812024-11-09T03:01:03.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148822024-11-09T03:01:03.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148832024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3cfe8f7c-56d4-4dea-b9f2-4ad7d8de0a9f", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148842024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148852024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148862024-11-09T03:01:03.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148872024-11-09T03:01:03.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148882024-11-09T03:01:03.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148892024-11-09T03:01:03.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148902024-11-09T03:01:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148912024-11-09T03:01:03.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
148922024-11-09T03:01:03.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148932024-11-09T03:01:03.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148942024-11-09T03:01:03.453ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
148952024-11-09T03:01:03.453ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
148962024-11-09T03:01:03.453ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e148bd5d-68ff-4623-9760-5edd759aad9d", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148972024-11-09T03:01:03.455ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.518368ms iteration = 31 status = {}
148982024-11-09T03:01:03.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148992024-11-09T03:01:03.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149002024-11-09T03:01:03.458ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
149012024-11-09T03:01:03.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149022024-11-09T03:01:03.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149032024-11-09T03:01:03.468ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
149042024-11-09T03:01:03.468ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f55c5a6f-e8f3-47a1-a8d6-3a4ba4737b63", "content-length": "134", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
149052024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
149062024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
149072024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
149082024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
149092024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
149102024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
149112024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
149122024-11-09T03:01:03.468ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
149132024-11-09T03:01:03.469ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
149142024-11-09T03:01:03.469ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
149152024-11-09T03:01:03.469ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
149162024-11-09T03:01:03.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149172024-11-09T03:01:03.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149182024-11-09T03:01:03.471ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
149192024-11-09T03:01:03.471ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "18a955c2-2294-49d8-87ef-4d4a8248c662", "content-length": "2", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
149202024-11-09T03:01:03.471ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
149212024-11-09T03:01:03.471ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "97eaf26d-4e09-4778-9d86-32ba5d162d64", "content-length": "52", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
149222024-11-09T03:01:03.471ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
149232024-11-09T03:01:03.471ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
149242024-11-09T03:01:03.484ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
149252024-11-09T03:01:03.582ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a2ecb953-081b-42eb-af88-2672e800bd8b", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
149262024-11-09T03:01:03.582ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
149272024-11-09T03:01:03.582ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
149282024-11-09T03:01:03.582ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd5ccd63-8c2a-41e5-bee3-bd326fc0b788", "content-length": "682", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
149292024-11-09T03:01:03.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149302024-11-09T03:01:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149312024-11-09T03:01:03.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149322024-11-09T03:01:03.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149332024-11-09T03:01:03.587ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d910872e-3b6b-450d-8517-039c56f83c19", "content-length": "691", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
149342024-11-09T03:01:03.587ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
149352024-11-09T03:01:03.587ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
149362024-11-09T03:01:03.587ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
149372024-11-09T03:01:03.588ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 416.753972ms iteration = 31 status = {}
149382024-11-09T03:01:03.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149392024-11-09T03:01:03.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149402024-11-09T03:01:03.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149412024-11-09T03:01:03.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149422024-11-09T03:01:03.599ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 427.473684ms iteration = 30 status = {}
149432024-11-09T03:01:03.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2a9ab2bf-ca42-4438-be53-5fd9653b8dc1 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149442024-11-09T03:01:03.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2a9ab2bf-ca42-4438-be53-5fd9653b8dc1 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149452024-11-09T03:01:03.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2a9ab2bf-ca42-4438-be53-5fd9653b8dc1 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149462024-11-09T03:01:04.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b1d8f2bb-1e54-4037-b57a-437dfe945564 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149472024-11-09T03:01:04.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b1d8f2bb-1e54-4037-b57a-437dfe945564 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149482024-11-09T03:01:04.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = b1d8f2bb-1e54-4037-b57a-437dfe945564 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149492024-11-09T03:01:05.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 3035114c-43d2-433b-9734-336e08ca6a99 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
149502024-11-09T03:01:05.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 3035114c-43d2-433b-9734-336e08ca6a99 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
149512024-11-09T03:01:05.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 3035114c-43d2-433b-9734-336e08ca6a99 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
149522024-11-09T03:01:05.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = a49f4b8f-0601-4da9-8db0-a4ae7ae8be2f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
149532024-11-09T03:01:05.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = a49f4b8f-0601-4da9-8db0-a4ae7ae8be2f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
149542024-11-09T03:01:05.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = a49f4b8f-0601-4da9-8db0-a4ae7ae8be2f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
149552024-11-09T03:01:06.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 99cce93b-2c41-4119-9704-324a92762489 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149562024-11-09T03:01:06.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 99cce93b-2c41-4119-9704-324a92762489 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149572024-11-09T03:01:06.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 99cce93b-2c41-4119-9704-324a92762489 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149582024-11-09T03:01:07.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ead1e2b-8d83-4021-b3d7-56a26172c6e3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149592024-11-09T03:01:07.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ead1e2b-8d83-4021-b3d7-56a26172c6e3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149602024-11-09T03:01:07.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 5ead1e2b-8d83-4021-b3d7-56a26172c6e3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149612024-11-09T03:01:08.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7bf439d-c423-4cd8-85d7-86b30a533e84 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149622024-11-09T03:01:08.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7bf439d-c423-4cd8-85d7-86b30a533e84 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149632024-11-09T03:01:08.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a7bf439d-c423-4cd8-85d7-86b30a533e84 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149642024-11-09T03:01:09.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = edbb2316-351a-4024-bc7d-94d5915c1d66 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149652024-11-09T03:01:09.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = edbb2316-351a-4024-bc7d-94d5915c1d66 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149662024-11-09T03:01:09.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = edbb2316-351a-4024-bc7d-94d5915c1d66 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149672024-11-09T03:01:10.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9a5ef8a-379b-4e9f-913d-95770397a22f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149682024-11-09T03:01:10.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9a5ef8a-379b-4e9f-913d-95770397a22f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149692024-11-09T03:01:10.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = c9a5ef8a-379b-4e9f-913d-95770397a22f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149702024-11-09T03:01:11.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 57391c39-3a6a-43e8-b043-64142eb7b8c6 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149712024-11-09T03:01:11.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 57391c39-3a6a-43e8-b043-64142eb7b8c6 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149722024-11-09T03:01:11.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 57391c39-3a6a-43e8-b043-64142eb7b8c6 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149732024-11-09T03:01:12.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1dae7621-31ac-4496-9e07-bdfbb78fcae4 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149742024-11-09T03:01:12.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1dae7621-31ac-4496-9e07-bdfbb78fcae4 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149752024-11-09T03:01:12.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1dae7621-31ac-4496-9e07-bdfbb78fcae4 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149762024-11-09T03:01:13.171ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
149772024-11-09T03:01:13.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
149782024-11-09T03:01:13.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149792024-11-09T03:01:13.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149802024-11-09T03:01:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149812024-11-09T03:01:13.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149822024-11-09T03:01:13.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d26117f-4ae3-466d-8def-b6122bcddd1d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149832024-11-09T03:01:13.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d26117f-4ae3-466d-8def-b6122bcddd1d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149842024-11-09T03:01:13.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1d26117f-4ae3-466d-8def-b6122bcddd1d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
149852024-11-09T03:01:13.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149862024-11-09T03:01:13.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149872024-11-09T03:01:13.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149882024-11-09T03:01:13.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
149892024-11-09T03:01:13.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149902024-11-09T03:01:13.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149912024-11-09T03:01:13.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149922024-11-09T03:01:13.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149932024-11-09T03:01:13.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149942024-11-09T03:01:13.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
149952024-11-09T03:01:13.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149962024-11-09T03:01:13.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149972024-11-09T03:01:13.217ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
149982024-11-09T03:01:13.217ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.276515ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
149992024-11-09T03:01:13.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.446991ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
150002024-11-09T03:01:14.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 357da863-d072-4cd2-8324-750957eea27e roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150012024-11-09T03:01:14.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 357da863-d072-4cd2-8324-750957eea27e resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150022024-11-09T03:01:14.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 357da863-d072-4cd2-8324-750957eea27e response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150032024-11-09T03:01:15.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 540 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = cb4aa1a2-acc0-4597-b8af-6a582b9f279e response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
150042024-11-09T03:01:15.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f13ff689-4a99-456a-bf0b-6ac0ad345131 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150052024-11-09T03:01:15.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f13ff689-4a99-456a-bf0b-6ac0ad345131 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150062024-11-09T03:01:15.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = f13ff689-4a99-456a-bf0b-6ac0ad345131 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150072024-11-09T03:01:16.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53689c23-87f6-4730-b3e7-5ba2d03ef2f7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150082024-11-09T03:01:16.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53689c23-87f6-4730-b3e7-5ba2d03ef2f7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150092024-11-09T03:01:16.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 53689c23-87f6-4730-b3e7-5ba2d03ef2f7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150102024-11-09T03:01:17.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e9a6cf8-475f-480a-aa70-0cde9cf74882 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150112024-11-09T03:01:17.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e9a6cf8-475f-480a-aa70-0cde9cf74882 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150122024-11-09T03:01:17.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 7e9a6cf8-475f-480a-aa70-0cde9cf74882 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150132024-11-09T03:01:18.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f817a59-44cf-4804-bf51-bef0bae7b8ff roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150142024-11-09T03:01:18.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f817a59-44cf-4804-bf51-bef0bae7b8ff resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150152024-11-09T03:01:18.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 2f817a59-44cf-4804-bf51-bef0bae7b8ff response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150162024-11-09T03:01:19.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3737a672-e069-401d-86cd-3f093f6b0786 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150172024-11-09T03:01:19.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3737a672-e069-401d-86cd-3f093f6b0786 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150182024-11-09T03:01:19.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 3737a672-e069-401d-86cd-3f093f6b0786 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150192024-11-09T03:01:20.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82a6670f-f807-4a00-8292-ccee4acabc25 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150202024-11-09T03:01:20.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82a6670f-f807-4a00-8292-ccee4acabc25 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150212024-11-09T03:01:20.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 82a6670f-f807-4a00-8292-ccee4acabc25 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150222024-11-09T03:01:21.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4a62a4f6-faed-4a59-ad45-c0320ba23e5c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150232024-11-09T03:01:21.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4a62a4f6-faed-4a59-ad45-c0320ba23e5c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150242024-11-09T03:01:21.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 4a62a4f6-faed-4a59-ad45-c0320ba23e5c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150252024-11-09T03:01:22.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 02086fcb-682e-45d2-8709-bc428094f60d roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150262024-11-09T03:01:22.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 02086fcb-682e-45d2-8709-bc428094f60d resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150272024-11-09T03:01:22.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 02086fcb-682e-45d2-8709-bc428094f60d response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150282024-11-09T03:01:22.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 77fa6b05-e6c7-4f16-b93d-e05322741bb4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
150292024-11-09T03:01:22.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 77fa6b05-e6c7-4f16-b93d-e05322741bb4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
150302024-11-09T03:01:22.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:61968 req_id = 77fa6b05-e6c7-4f16-b93d-e05322741bb4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
150312024-11-09T03:01:23.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
150322024-11-09T03:01:23.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
150332024-11-09T03:01:23.172ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
150342024-11-09T03:01:23.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150352024-11-09T03:01:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
150362024-11-09T03:01:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150372024-11-09T03:01:23.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
150382024-11-09T03:01:23.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
150392024-11-09T03:01:23.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150402024-11-09T03:01:23.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
150412024-11-09T03:01:23.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150422024-11-09T03:01:23.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150432024-11-09T03:01:23.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150442024-11-09T03:01:23.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150452024-11-09T03:01:23.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150462024-11-09T03:01:23.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
150472024-11-09T03:01:23.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
150482024-11-09T03:01:23.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
150492024-11-09T03:01:23.220ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
150502024-11-09T03:01:23.220ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.543903ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
150512024-11-09T03:01:23.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.264384ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
150522024-11-09T03:01:23.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28a31542-cd25-4ce3-939d-233de2f1c7f3 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150532024-11-09T03:01:23.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28a31542-cd25-4ce3-939d-233de2f1c7f3 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150542024-11-09T03:01:23.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 28a31542-cd25-4ce3-939d-233de2f1c7f3 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150552024-11-09T03:01:24.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e274d05c-f16d-4bf2-adc6-1e78f78c1cc7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150562024-11-09T03:01:24.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e274d05c-f16d-4bf2-adc6-1e78f78c1cc7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150572024-11-09T03:01:24.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e274d05c-f16d-4bf2-adc6-1e78f78c1cc7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150582024-11-09T03:01:25.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 098fcc0a-471c-408d-b432-d51c34861190 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150592024-11-09T03:01:25.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 098fcc0a-471c-408d-b432-d51c34861190 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150602024-11-09T03:01:25.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 098fcc0a-471c-408d-b432-d51c34861190 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150612024-11-09T03:01:26.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e36e497c-5e09-4587-a7a2-ba4c854b0d56 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150622024-11-09T03:01:26.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e36e497c-5e09-4587-a7a2-ba4c854b0d56 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150632024-11-09T03:01:26.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = e36e497c-5e09-4587-a7a2-ba4c854b0d56 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150642024-11-09T03:01:27.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 785624c8-442a-4b49-a61b-9bcde4c2543a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150652024-11-09T03:01:27.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 785624c8-442a-4b49-a61b-9bcde4c2543a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150662024-11-09T03:01:27.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 785624c8-442a-4b49-a61b-9bcde4c2543a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150672024-11-09T03:01:28.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 520999c5-9c33-43e2-bb95-6dda04d208bf roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150682024-11-09T03:01:28.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 520999c5-9c33-43e2-bb95-6dda04d208bf resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150692024-11-09T03:01:28.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 520999c5-9c33-43e2-bb95-6dda04d208bf response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150702024-11-09T03:01:29.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 814b1c00-a1a6-448b-b7c4-f7754b300d07 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150712024-11-09T03:01:29.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 814b1c00-a1a6-448b-b7c4-f7754b300d07 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150722024-11-09T03:01:29.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 814b1c00-a1a6-448b-b7c4-f7754b300d07 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150732024-11-09T03:01:30.155ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 545 local_addr = [fd00:1122:3344:101::b]:43847 method = GET remote_addr = [fd00:1122:3344:101::d]:51332 req_id = ade9ad2f-afbe-4996-9742-187633ae968f response_code = 200 uri = /c3da9028-2f6b-4199-8d06-98c01f75b9bf
150742024-11-09T03:01:30.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01b745a4-c7fb-416e-ba9b-91581f937f7a roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150752024-11-09T03:01:30.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01b745a4-c7fb-416e-ba9b-91581f937f7a resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150762024-11-09T03:01:30.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 01b745a4-c7fb-416e-ba9b-91581f937f7a response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150772024-11-09T03:01:31.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf06eee1-99dc-48c0-a0d2-f9ea8a14afc7 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150782024-11-09T03:01:31.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf06eee1-99dc-48c0-a0d2-f9ea8a14afc7 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150792024-11-09T03:01:31.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = bf06eee1-99dc-48c0-a0d2-f9ea8a14afc7 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150802024-11-09T03:01:32.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1157737e-0d26-40b8-abba-80557d80f2a8 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150812024-11-09T03:01:32.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1157737e-0d26-40b8-abba-80557d80f2a8 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150822024-11-09T03:01:32.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 1157737e-0d26-40b8-abba-80557d80f2a8 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
150832024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
150842024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
150852024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
150862024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
150872024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150882024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
150892024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
150902024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
150912024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
150922024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
150932024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
150942024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
150952024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
150962024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
150972024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150982024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
150992024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
151002024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
151012024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
151022024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
151032024-11-09T03:01:33.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
151042024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
151052024-11-09T03:01:33.173ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
151062024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
151072024-11-09T03:01:33.173ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
151082024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
151092024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
151102024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.59\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
151112024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
151122024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
151132024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
151142024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
151152024-11-09T03:01:33.173ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
151162024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
151172024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
151182024-11-09T03:01:33.173ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
151192024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
151202024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
151212024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
151222024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
151232024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
151242024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
151252024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
151262024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
151272024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
151282024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
151292024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
151302024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
151312024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
151322024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
151332024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
151342024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
151352024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
151362024-11-09T03:01:33.173ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:51:33.173209205 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
151372024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
151382024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
151392024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.79\u{b5}s iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
151402024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
151412024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
151422024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.46\u{b5}s iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
151432024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.68\u{b5}s iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
151442024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
151452024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
151462024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
151472024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
151482024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.561\u{b5}s iteration = 31 status = {"errors":[],"records_set_to_done":[]}
151492024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
151502024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
151512024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
151522024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
151532024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
151542024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
151552024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
151562024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
151572024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
151582024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
151592024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
151602024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
151612024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
151622024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
151632024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
151642024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
151652024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
151662024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
151672024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
151682024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
151692024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
151702024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
151712024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
151722024-11-09T03:01:33.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 508088208 } })
151732024-11-09T03:01:33.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
151742024-11-09T03:01:33.173ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 508193231 } })
151752024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
151762024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
151772024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
151782024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.428169ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
151792024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
151802024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
151812024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
151822024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.285276ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
151832024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
151842024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
151852024-11-09T03:01:33.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
151862024-11-09T03:01:33.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
151872024-11-09T03:01:33.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
151882024-11-09T03:01:33.188ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 15.307626ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
151892024-11-09T03:01:33.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151902024-11-09T03:01:33.192ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 526821966 } })
151912024-11-09T03:01:33.192ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
151922024-11-09T03:01:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
151932024-11-09T03:01:33.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
151942024-11-09T03:01:33.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
151952024-11-09T03:01:33.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
151962024-11-09T03:01:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
151972024-11-09T03:01:33.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
151982024-11-09T03:01:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
151992024-11-09T03:01:33.203ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 537922385 } })
152002024-11-09T03:01:33.204ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
152012024-11-09T03:01:33.204ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:51:33.173209205 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
152022024-11-09T03:01:33.204ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 31.479271ms iteration = 16 status = {"expiration":"2024-11-09T02:51:33.173209205Z","pruned":[]}
152032024-11-09T03:01:33.207ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 33.881041ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
152042024-11-09T03:01:33.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152052024-11-09T03:01:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152062024-11-09T03:01:33.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152072024-11-09T03:01:33.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
152082024-11-09T03:01:33.257ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152092024-11-09T03:01:33.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
152102024-11-09T03:01:33.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152112024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
152122024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
152132024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
152142024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
152152024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
152162024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
152172024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152182024-11-09T03:01:33.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152192024-11-09T03:01:33.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
152202024-11-09T03:01:33.262ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
152212024-11-09T03:01:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
152222024-11-09T03:01:33.263ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
152232024-11-09T03:01:33.263ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
152242024-11-09T03:01:33.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
152252024-11-09T03:01:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
152262024-11-09T03:01:33.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152272024-11-09T03:01:33.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
152282024-11-09T03:01:33.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
152292024-11-09T03:01:33.264ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
152302024-11-09T03:01:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
152312024-11-09T03:01:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
152322024-11-09T03:01:33.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152332024-11-09T03:01:33.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
152342024-11-09T03:01:33.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152352024-11-09T03:01:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152362024-11-09T03:01:33.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152372024-11-09T03:01:33.267ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152382024-11-09T03:01:33.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152392024-11-09T03:01:33.268ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152402024-11-09T03:01:33.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
152412024-11-09T03:01:33.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
152422024-11-09T03:01:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
152432024-11-09T03:01:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
152442024-11-09T03:01:33.271ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
152452024-11-09T03:01:33.271ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
152462024-11-09T03:01:33.271ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 97.937075ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
152472024-11-09T03:01:33.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
152482024-11-09T03:01:33.271ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
152492024-11-09T03:01:33.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
152502024-11-09T03:01:33.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
152512024-11-09T03:01:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
152522024-11-09T03:01:33.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152532024-11-09T03:01:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
152542024-11-09T03:01:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
152552024-11-09T03:01:33.272ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
152562024-11-09T03:01:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152572024-11-09T03:01:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
152582024-11-09T03:01:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
152592024-11-09T03:01:33.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152602024-11-09T03:01:33.274ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
152612024-11-09T03:01:33.275ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
152622024-11-09T03:01:33.275ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
152632024-11-09T03:01:33.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
152642024-11-09T03:01:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
152652024-11-09T03:01:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
152662024-11-09T03:01:33.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
152672024-11-09T03:01:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
152682024-11-09T03:01:33.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152692024-11-09T03:01:33.279ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 613866015 } })
152702024-11-09T03:01:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
152712024-11-09T03:01:33.279ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
152722024-11-09T03:01:33.279ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
152732024-11-09T03:01:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
152742024-11-09T03:01:33.280ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152752024-11-09T03:01:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
152762024-11-09T03:01:33.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
152772024-11-09T03:01:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
152782024-11-09T03:01:33.286ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
152792024-11-09T03:01:33.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
152802024-11-09T03:01:33.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
152812024-11-09T03:01:33.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152822024-11-09T03:01:33.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
152832024-11-09T03:01:33.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
152842024-11-09T03:01:33.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
152852024-11-09T03:01:33.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152862024-11-09T03:01:33.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
152872024-11-09T03:01:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152882024-11-09T03:01:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
152892024-11-09T03:01:33.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
152902024-11-09T03:01:33.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
152912024-11-09T03:01:33.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
152922024-11-09T03:01:33.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152932024-11-09T03:01:33.296ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 123.685306ms iteration = 7 status = {"nsuccess":5}
152942024-11-09T03:01:33.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152952024-11-09T03:01:33.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152962024-11-09T03:01:33.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
152972024-11-09T03:01:33.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
152982024-11-09T03:01:33.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
152992024-11-09T03:01:33.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
153002024-11-09T03:01:33.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
153012024-11-09T03:01:33.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
153022024-11-09T03:01:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
153032024-11-09T03:01:33.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
153042024-11-09T03:01:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
153052024-11-09T03:01:33.304ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
153062024-11-09T03:01:33.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
153072024-11-09T03:01:33.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
153082024-11-09T03:01:33.313ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
153092024-11-09T03:01:33.313ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
153102024-11-09T03:01:33.313ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
153112024-11-09T03:01:33.313ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
153122024-11-09T03:01:33.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
153132024-11-09T03:01:33.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
153142024-11-09T03:01:33.325ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
153152024-11-09T03:01:33.325ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.733216ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
153162024-11-09T03:01:33.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153172024-11-09T03:01:33.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
153182024-11-09T03:01:33.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
153192024-11-09T03:01:33.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
153202024-11-09T03:01:33.331ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 158.577077ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
153212024-11-09T03:01:33.334ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
153222024-11-09T03:01:33.334ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
153232024-11-09T03:01:33.334ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d414f28-68e0-44d3-befb-c5f1da3669de", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:32 GMT"} })
153242024-11-09T03:01:33.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
153252024-11-09T03:01:33.335ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
153262024-11-09T03:01:33.335ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
153272024-11-09T03:01:33.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
153282024-11-09T03:01:33.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
153292024-11-09T03:01:33.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
153302024-11-09T03:01:33.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153312024-11-09T03:01:33.338ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
153322024-11-09T03:01:33.338ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
153332024-11-09T03:01:33.338ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 165.093552ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
153342024-11-09T03:01:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
153352024-11-09T03:01:33.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
153362024-11-09T03:01:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
153372024-11-09T03:01:33.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153382024-11-09T03:01:33.350ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
153392024-11-09T03:01:33.350ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
153402024-11-09T03:01:33.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
153412024-11-09T03:01:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
153422024-11-09T03:01:33.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 178.275275ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
153432024-11-09T03:01:33.351ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
153442024-11-09T03:01:33.351ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
153452024-11-09T03:01:33.351ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
153462024-11-09T03:01:33.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 179.061671ms iteration = 16 status = {"generation":2}
153472024-11-09T03:01:33.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
153482024-11-09T03:01:33.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
153492024-11-09T03:01:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
153502024-11-09T03:01:33.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
153512024-11-09T03:01:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
153522024-11-09T03:01:33.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
153532024-11-09T03:01:33.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
153542024-11-09T03:01:33.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
153552024-11-09T03:01:33.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
153562024-11-09T03:01:33.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153572024-11-09T03:01:33.359ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
153582024-11-09T03:01:33.359ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
153592024-11-09T03:01:33.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
153602024-11-09T03:01:33.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
153612024-11-09T03:01:33.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
153622024-11-09T03:01:33.360ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
153632024-11-09T03:01:33.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
153642024-11-09T03:01:33.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
153652024-11-09T03:01:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
153662024-11-09T03:01:33.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153672024-11-09T03:01:33.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
153682024-11-09T03:01:33.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
153692024-11-09T03:01:33.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
153702024-11-09T03:01:33.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
153712024-11-09T03:01:33.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
153722024-11-09T03:01:33.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153732024-11-09T03:01:33.369ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
153742024-11-09T03:01:33.369ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
153752024-11-09T03:01:33.369ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
153762024-11-09T03:01:33.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 196.883229ms iteration = 16 status = {"generation":1}
153772024-11-09T03:01:33.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
153782024-11-09T03:01:33.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 196.91764ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
153792024-11-09T03:01:33.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
153802024-11-09T03:01:33.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
153812024-11-09T03:01:33.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
153822024-11-09T03:01:33.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
153832024-11-09T03:01:33.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
153842024-11-09T03:01:33.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
153852024-11-09T03:01:33.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
153862024-11-09T03:01:33.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153872024-11-09T03:01:33.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
153882024-11-09T03:01:33.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
153892024-11-09T03:01:33.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
153902024-11-09T03:01:33.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
153912024-11-09T03:01:33.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
153922024-11-09T03:01:33.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
153932024-11-09T03:01:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
153942024-11-09T03:01:33.394ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
153952024-11-09T03:01:33.394ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
153962024-11-09T03:01:33.394ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 221.878075ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
153972024-11-09T03:01:33.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
153982024-11-09T03:01:33.399ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
153992024-11-09T03:01:33.400ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c469381b-a75e-436a-8c48-e192b50822f7", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154002024-11-09T03:01:33.400ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
154012024-11-09T03:01:33.402ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
154022024-11-09T03:01:33.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154032024-11-09T03:01:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
154042024-11-09T03:01:33.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
154052024-11-09T03:01:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
154062024-11-09T03:01:33.411ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 238.686712ms iteration = 31 status = 0
154072024-11-09T03:01:33.423ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
154082024-11-09T03:01:33.423ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 250.169709ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
154092024-11-09T03:01:33.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154102024-11-09T03:01:33.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154112024-11-09T03:01:33.444ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
154122024-11-09T03:01:33.444ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 271.837387ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
154132024-11-09T03:01:33.450ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 277.78125ms iteration = 34 status = {"physical_disks_added":0}
154142024-11-09T03:01:33.486ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.908277ms iteration = 31 status = {}
154152024-11-09T03:01:33.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
154162024-11-09T03:01:33.522ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
154172024-11-09T03:01:33.522ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aa2205a-2ab8-4799-a7f1-04979c1ddc4a", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154182024-11-09T03:01:33.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
154192024-11-09T03:01:33.525ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
154202024-11-09T03:01:33.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
154212024-11-09T03:01:33.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6c527f1e-6f2e-433f-901b-89715d31b718", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
154222024-11-09T03:01:33.579ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
154232024-11-09T03:01:33.580ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
154242024-11-09T03:01:33.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ec172ee-c5c0-407b-bbb9-ae78f4f0228a", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
154252024-11-09T03:01:33.581ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
154262024-11-09T03:01:33.583ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
154272024-11-09T03:01:33.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 409.946381ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
154282024-11-09T03:01:33.640ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
154292024-11-09T03:01:33.640ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1490189-9c56-4523-9203-44f477d20541", "content-length": "2", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154302024-11-09T03:01:33.642ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
154312024-11-09T03:01:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
154322024-11-09T03:01:33.651ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
154332024-11-09T03:01:33.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04082208-809b-460a-ada7-0d089bc39652 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
154342024-11-09T03:01:33.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04082208-809b-460a-ada7-0d089bc39652 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
154352024-11-09T03:01:33.686ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "466114cf-cc88-4678-a887-eaa9f3cc1e0c", "content-length": "691", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154362024-11-09T03:01:33.686ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
154372024-11-09T03:01:33.686ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
154382024-11-09T03:01:33.686ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
154392024-11-09T03:01:33.687ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 515.256878ms iteration = 32 status = {}
154402024-11-09T03:01:33.736ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
154412024-11-09T03:01:33.736ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
154422024-11-09T03:01:33.736ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "67add59c-ebb4-4152-89fa-276fc8c8dde0", "content-length": "372", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154432024-11-09T03:01:33.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
154442024-11-09T03:01:33.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
154452024-11-09T03:01:33.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154462024-11-09T03:01:33.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 04082208-809b-460a-ada7-0d089bc39652 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
154472024-11-09T03:01:33.738ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 565.67619ms iteration = 31 status = null
154482024-11-09T03:01:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
154492024-11-09T03:01:33.741ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154502024-11-09T03:01:33.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154512024-11-09T03:01:33.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154522024-11-09T03:01:33.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154532024-11-09T03:01:33.745ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154542024-11-09T03:01:33.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154552024-11-09T03:01:33.747ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154562024-11-09T03:01:33.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154572024-11-09T03:01:33.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154582024-11-09T03:01:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154592024-11-09T03:01:33.776ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154602024-11-09T03:01:33.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154612024-11-09T03:01:33.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154622024-11-09T03:01:33.778ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
154632024-11-09T03:01:33.778ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
154642024-11-09T03:01:33.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154652024-11-09T03:01:33.778ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8a2d8720-b354-466c-9d2a-f0d545fffe7a", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154662024-11-09T03:01:33.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
154672024-11-09T03:01:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
154682024-11-09T03:01:33.780ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154692024-11-09T03:01:33.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
154702024-11-09T03:01:33.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
154712024-11-09T03:01:33.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
154722024-11-09T03:01:33.783ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154732024-11-09T03:01:33.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154742024-11-09T03:01:33.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154752024-11-09T03:01:33.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
154762024-11-09T03:01:33.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154772024-11-09T03:01:33.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
154782024-11-09T03:01:33.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154792024-11-09T03:01:33.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154802024-11-09T03:01:33.787ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
154812024-11-09T03:01:33.787ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
154822024-11-09T03:01:33.788ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "659811c7-a7c3-4bdd-a52a-75428755a97a", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
154832024-11-09T03:01:33.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154842024-11-09T03:01:33.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154852024-11-09T03:01:33.790ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 617.474011ms iteration = 32 status = {}
154862024-11-09T03:01:33.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154872024-11-09T03:01:33.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154882024-11-09T03:01:33.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154892024-11-09T03:01:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154902024-11-09T03:01:33.794ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154912024-11-09T03:01:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154922024-11-09T03:01:33.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
154932024-11-09T03:01:33.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
154942024-11-09T03:01:33.800ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
154952024-11-09T03:01:33.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
154962024-11-09T03:01:33.800ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
154972024-11-09T03:01:33.801ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b7879b1f-dcc8-4c37-98f2-36e1e73aeaf3", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
154982024-11-09T03:01:33.801ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
154992024-11-09T03:01:33.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155002024-11-09T03:01:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155012024-11-09T03:01:33.803ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "39d6ed23-7e3d-4e8f-a9b9-d02dd7bd74f3", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
155022024-11-09T03:01:33.803ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
155032024-11-09T03:01:33.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155042024-11-09T03:01:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155052024-11-09T03:01:33.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3d4494c0-7801-48df-9296-46abf7d81cbd", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
155062024-11-09T03:01:33.807ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
155072024-11-09T03:01:33.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155082024-11-09T03:01:33.809ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
155092024-11-09T03:01:33.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 636.854031ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
155102024-11-09T03:01:33.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
155112024-11-09T03:01:33.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155122024-11-09T03:01:33.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155132024-11-09T03:01:33.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155142024-11-09T03:01:33.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155152024-11-09T03:01:33.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155162024-11-09T03:01:33.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155172024-11-09T03:01:33.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155182024-11-09T03:01:33.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155192024-11-09T03:01:33.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155202024-11-09T03:01:33.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155212024-11-09T03:01:33.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155222024-11-09T03:01:33.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155232024-11-09T03:01:33.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155242024-11-09T03:01:33.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155252024-11-09T03:01:33.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155262024-11-09T03:01:33.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155272024-11-09T03:01:33.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155282024-11-09T03:01:33.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
155292024-11-09T03:01:33.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155302024-11-09T03:01:33.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155312024-11-09T03:01:33.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155322024-11-09T03:01:33.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155332024-11-09T03:01:33.834ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155342024-11-09T03:01:33.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155352024-11-09T03:01:33.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155362024-11-09T03:01:33.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
155372024-11-09T03:01:33.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155382024-11-09T03:01:33.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155392024-11-09T03:01:33.844ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
155402024-11-09T03:01:33.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155412024-11-09T03:01:33.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155422024-11-09T03:01:33.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155432024-11-09T03:01:33.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
155442024-11-09T03:01:33.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155452024-11-09T03:01:33.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155462024-11-09T03:01:33.848ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
155472024-11-09T03:01:33.848ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
155482024-11-09T03:01:33.848ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
155492024-11-09T03:01:33.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155502024-11-09T03:01:33.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155512024-11-09T03:01:33.861ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
155522024-11-09T03:01:33.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155532024-11-09T03:01:33.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155542024-11-09T03:01:33.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
155552024-11-09T03:01:33.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e6c1d70-1284-4c85-8897-1b50381fea61", "content-length": "134", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
155562024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
155572024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
155582024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
155592024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
155602024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
155612024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
155622024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
155632024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
155642024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
155652024-11-09T03:01:33.869ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
155662024-11-09T03:01:33.870ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
155672024-11-09T03:01:33.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155682024-11-09T03:01:33.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155692024-11-09T03:01:33.871ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
155702024-11-09T03:01:33.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e707432c-a0a1-457c-bc2e-b358b624bbc0", "content-length": "2", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
155712024-11-09T03:01:33.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
155722024-11-09T03:01:33.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "62b6e02f-c9de-4809-9390-d2fcf8de472e", "content-length": "52", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
155732024-11-09T03:01:33.872ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
155742024-11-09T03:01:33.872ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
155752024-11-09T03:01:33.897ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
155762024-11-09T03:01:33.897ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
155772024-11-09T03:01:33.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155782024-11-09T03:01:33.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155792024-11-09T03:01:33.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
155802024-11-09T03:01:33.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
155812024-11-09T03:01:33.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
155822024-11-09T03:01:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
155832024-11-09T03:01:33.935ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
155842024-11-09T03:01:33.968ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6dfd748c-7143-4cb5-92f6-4a7dfac166d5", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
155852024-11-09T03:01:33.968ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
155862024-11-09T03:01:33.968ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
155872024-11-09T03:01:33.968ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "12212623-5cc7-46da-be4e-072370ed5aa4", "content-length": "682", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
155882024-11-09T03:01:33.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155892024-11-09T03:01:33.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155902024-11-09T03:01:33.968ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "e9ab22a8-d002-458b-8b44-fa1e6403ed0e", "date": "Sat, 09 Nov 2024 03:01:33 GMT"} })
155912024-11-09T03:01:33.970ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
155922024-11-09T03:01:33.970ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 797.282976ms
155932024-11-09T03:01:33.970ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 797.294516ms iteration = 4 status = {}
155942024-11-09T03:01:33.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155952024-11-09T03:01:33.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155962024-11-09T03:01:33.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155972024-11-09T03:01:33.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
155982024-11-09T03:01:33.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
155992024-11-09T03:01:33.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
156002024-11-09T03:01:33.985ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 812.542572ms iteration = 31 status = {}
156012024-11-09T03:01:34.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8c3d8c7e-e883-4897-b47e-82cdd5a5eb5f roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156022024-11-09T03:01:34.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8c3d8c7e-e883-4897-b47e-82cdd5a5eb5f resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156032024-11-09T03:01:34.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 8c3d8c7e-e883-4897-b47e-82cdd5a5eb5f response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156042024-11-09T03:01:35.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 4caf7e5c-4122-49aa-b96f-33e3a8c1d3d6 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
156052024-11-09T03:01:35.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 4caf7e5c-4122-49aa-b96f-33e3a8c1d3d6 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
156062024-11-09T03:01:35.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = 4caf7e5c-4122-49aa-b96f-33e3a8c1d3d6 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
156072024-11-09T03:01:35.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = d27fb455-9f14-430e-8042-4c5a02eab2df roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
156082024-11-09T03:01:35.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = d27fb455-9f14-430e-8042-4c5a02eab2df resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
156092024-11-09T03:01:35.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41119 req_id = d27fb455-9f14-430e-8042-4c5a02eab2df response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
156102024-11-09T03:01:35.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a578f437-0141-47d8-b6c2-a641bad41060 roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156112024-11-09T03:01:35.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a578f437-0141-47d8-b6c2-a641bad41060 resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156122024-11-09T03:01:35.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = a578f437-0141-47d8-b6c2-a641bad41060 response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156132024-11-09T03:01:36.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 534b4a68-1346-457a-abeb-b3bc5377c86c roles = RoleSet { roles: {} } uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156142024-11-09T03:01:36.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 534b4a68-1346-457a-abeb-b3bc5377c86c resource = Database result = Ok(()) uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648
156152024-11-09T03:01:36.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44433 req_id = 534b4a68-1346-457a-abeb-b3bc5377c86c response_code = 200 uri = /probes/f032ba4a-ac68-41c0-a068-00d3371df648