Max level shown:
12026-03-03T18:54:59.772ZDEBGtest_instance_metrics (init_with_steps): Running step start_crdb
22026-03-03T18:54:59.773ZDEBGtest_instance_metrics: Starting CRDB
32026-03-03T18:54:59.773ZINFOtest_instance_metrics: cockroach temporary directory: /var/tmp/omicron_tmp/.tmpYACANd
42026-03-03T18:54:59.773ZINFOtest_instance_metrics: cockroach: copying from seed tarball (/var/tmp/omicron_tmp/crdb-base-build/01a593466edfe10be8065d09575d9108ee70f096422ef511649ff51492c1a319.tar) to storage directory (/var/tmp/omicron_tmp/.tmpYACANd/data)
52026-03-03T18:54:59.788ZINFOtest_instance_metrics: cockroach command line: cockroach start-single-node --insecure --http-addr=:0 --store=path=/var/tmp/omicron_tmp/.tmpYACANd/data,ballast-size=0 --listen-addr [::1]:0 --listening-url-file /var/tmp/omicron_tmp/.tmpYACANd/listen-url --max-sql-memory 256MiB
62026-03-03T18:54:59.788ZINFOtest_instance_metrics: cockroach environment: BUILDOMAT_JOB_ID=01KJTF30Q8FNYCP33P0AJV342W BUILDOMAT_TASK_ID=4 CARGO=/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/bin/cargo CARGO_HOME=/home/build/.cargo CARGO_INCREMENTAL=0 CARGO_MANIFEST_DIR=/work/oxidecomputer/omicron/nexus CARGO_PKG_AUTHORS= CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_LICENSE=MPL-2.0 CARGO_PKG_LICENSE_FILE= CARGO_PKG_NAME=omicron-nexus CARGO_PKG_REPOSITORY= CARGO_PKG_RUST_VERSION= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= CARGO_TERM_COLOR=always CI=true CRDB_SEED_TAR=/var/tmp/omicron_tmp/crdb-base-build/01a593466edfe10be8065d09575d9108ee70f096422ef511649ff51492c1a319.tar GITHUB_BRANCH=ea-ztnrpmzzkqvp GITHUB_REF=refs/heads/ea-ztnrpmzzkqvp GITHUB_REPOSITORY=oxidecomputer/omicron GITHUB_SHA=c07c7685c434eb5b35e41fa764918d3deb749829 GOTRACEBACK=crash HOME=/home/build LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-f7ed203bc494f61c/out:/work/oxidecomputer/omicron/target/debug/build/blake3-f343411090537ee9/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-84e3a942d0ba32cb/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-22a9fe5c9961762c/out/build:/work/oxidecomputer/omicron/target/debug/build/libz-sys-a45bcc1bdf81d4f5/out/lib:/work/oxidecomputer/omicron/target/debug/build/psm-7171f0fac820b0ee/out:/work/oxidecomputer/omicron/target/debug/build/ring-970c0722df753325/out:/work/oxidecomputer/omicron/target/debug/build/tofino-97249330d8dd6530/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-4ce5ac15611f058d/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib LOGNAME=build NEXTEST=1 NEXTEST_ATTEMPT=1 NEXTEST_ATTEMPT_ID=6d9196a9-0f66-4d15-9474-d9848c8f7422:omicron-nexus::test_all$integration_tests::instances::test_instance_metrics NEXTEST_BINARY_ID=omicron-nexus::test_all NEXTEST_BIN_EXE_nexus=/work/oxidecomputer/omicron/target/debug/nexus NEXTEST_BIN_EXE_schema-updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_BIN_EXE_schema_updater=/work/oxidecomputer/omicron/target/debug/schema-updater NEXTEST_EXECUTION_MODE=process-per-test NEXTEST_LD_LIBRARY_PATH=/work/oxidecomputer/omicron/target/debug/build/aws-lc-sys-f7ed203bc494f61c/out:/work/oxidecomputer/omicron/target/debug/build/blake3-f343411090537ee9/out:/work/oxidecomputer/omicron/target/debug/build/bzip2-sys-84e3a942d0ba32cb/out/lib:/work/oxidecomputer/omicron/target/debug/build/libgit2-sys-22a9fe5c9961762c/out/build:/work/oxidecomputer/omicron/target/debug/build/libz-sys-a45bcc1bdf81d4f5/out/lib:/work/oxidecomputer/omicron/target/debug/build/psm-7171f0fac820b0ee/out:/work/oxidecomputer/omicron/target/debug/build/ring-970c0722df753325/out:/work/oxidecomputer/omicron/target/debug/build/tofino-97249330d8dd6530/out:/work/oxidecomputer/omicron/target/debug/build/zstd-sys-4ce5ac15611f058d/out:/work/oxidecomputer/omicron/target/debug/deps:/work/oxidecomputer/omicron/target/debug:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/home/build/.rustup/toolchains/1.91.1-x86_64-unknown-linux-gnu/lib NEXTEST_PROFILE=ci NEXTEST_RUN_ID=6d9196a9-0f66-4d15-9474-d9848c8f7422 NEXTEST_RUN_MODE=test NEXTEST_STATE_DIR=/tmp/nextest-state.Q0LfUm NEXTEST_STRESS_CURRENT=none NEXTEST_STRESS_TOTAL=none NEXTEST_TEST_GLOBAL_SLOT=3 NEXTEST_TEST_GROUP=@global NEXTEST_TEST_GROUP_SLOT=none NEXTEST_TEST_NAME=integration_tests::instances::test_instance_metrics NEXTEST_TEST_PHASE=run NEXTEST_TOTAL_ATTEMPTS=1 OUT_DIR=/work/oxidecomputer/omicron/target/debug/build/omicron-nexus-459a70e126ba99a1/out PATH=/work/oxidecomputer/omicron/out/mgd/root/opt/oxide/mgd/bin:/work/oxidecomputer/omicron/out/dendrite-stub/bin:/work/oxidecomputer/omicron/out/clickhouse:/work/oxidecomputer/omicron/out/cockroachdb/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin PWD=/work/oxidecomputer/omicron RUSTC_BOOTSTRAP=1 RUSTDOCFLAGS=--document-private-items -D warnings RUSTFLAGS=--cfg tokio_unstable -D warnings RUSTUP_HOME=/home/build/.rustup RUSTUP_TOOLCHAIN=1.91.1-x86_64-unknown-linux-gnu RUST_BACKTRACE=1 RUST_RECURSION_COUNT=1 SHLVL=1 SSL_CERT_DIR=/usr/lib/ssl/certs SSL_CERT_FILE=/usr/lib/ssl/certs/ca-certificates.crt TMPDIR=/var/tmp/omicron_tmp TZ=UTC USER=build
72026-03-03T18:55:00.909ZINFOtest_instance_metrics: cockroach pid: 213539
82026-03-03T18:55:00.909ZINFOtest_instance_metrics: cockroach listen URL: postgresql://root@[::1]:41875/omicron?sslmode=disable
92026-03-03T18:55:00.913ZDEBGtest_instance_metrics (init_with_steps): Running step start_clickhouse
102026-03-03T18:55:00.913ZDEBGtest_instance_metrics: Starting Clickhouse
112026-03-03T18:55:01.428ZDEBGtest_instance_metrics (init_with_steps): Running step start_internal_dns
122026-03-03T18:55:01.428ZINFOtest_instance_metrics (store): opening sled database path = /var/tmp/omicron_tmp/.tmp4LAnJS
132026-03-03T18:55:01.447ZINFOtest_instance_metrics (store): pruning trees for generations newer than 0
142026-03-03T18:55:01.447ZINFOtest_instance_metrics (store): pruning trees for generations older than 0 keep = 3
152026-03-03T18:55:01.447ZINFOtest_instance_metrics (dns): DNS server bound to address kind = dns local_address = [::1]:57905
162026-03-03T18:55:01.447ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:43761 method = GET path = /config versions = all starting from 2.0.0
172026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:43761 method = GET path = /config versions = from 1.0.0 to 2.0.0
182026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:43761 method = PUT path = /config versions = all starting from 2.0.0
192026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:43761 method = PUT path = /config versions = from 1.0.0 to 2.0.0
202026-03-03T18:55:01.448ZINFOtest_instance_metrics (http): listening kind = dns local_addr = [::1]:43761
212026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:43761
222026-03-03T18:55:01.448ZDEBGtest_instance_metrics (init_with_steps): Running step start_external_dns
232026-03-03T18:55:01.448ZINFOtest_instance_metrics (store): opening sled database path = /var/tmp/omicron_tmp/.tmpyU1ELI
242026-03-03T18:55:01.448ZINFOtest_instance_metrics (store): pruning trees for generations newer than 0
252026-03-03T18:55:01.448ZINFOtest_instance_metrics (store): pruning trees for generations older than 0 keep = 3
262026-03-03T18:55:01.448ZINFOtest_instance_metrics (dns): DNS server bound to address kind = dns local_address = [::1]:51732
272026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:41835 method = GET path = /config versions = all starting from 2.0.0
282026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:41835 method = GET path = /config versions = from 1.0.0 to 2.0.0
292026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:41835 method = PUT path = /config versions = all starting from 2.0.0
302026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): registered endpoint kind = dns local_addr = [::1]:41835 method = PUT path = /config versions = from 1.0.0 to 2.0.0
312026-03-03T18:55:01.448ZINFOtest_instance_metrics (http): listening kind = dns local_addr = [::1]:41835
322026-03-03T18:55:01.448ZDEBGtest_instance_metrics (http): successfully registered DTrace USDT probes kind = dns local_addr = [::1]:41835
332026-03-03T18:55:01.448ZDEBGtest_instance_metrics (init_with_steps): Running step start_nexus_internal
342026-03-03T18:55:01.448ZDEBGtest_instance_metrics: Starting Nexus (internal API)
352026-03-03T18:55:01.448ZINFOtest_instance_metrics: setting up nexus server
362026-03-03T18:55:01.448ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Action
372026-03-03T18:55:01.448ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AuditLog
382026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AnyActor
392026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AuthenticatedActor
402026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = BlueprintConfig
412026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Database
422026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = DnsConfig
432026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Fleet
442026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Inventory
452026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = IpPoolList
462026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = VpcList
472026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = ConsoleSessionList
482026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = DeviceAuthRequestList
492026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = QuiesceState
502026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloCertificateList
512026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloGroupList
522026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloIdentityProviderList
532026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloUserList
542026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloUserSessionList
552026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloUserTokenList
562026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SubnetPoolList
572026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = UpdateTrustRootList
582026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = TargetReleaseConfig
592026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AlertClassList
602026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = ScimClientBearerTokenList
612026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = MulticastGroupList
622026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Project
632026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Disk
642026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Snapshot
652026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = ProjectImage
662026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AffinityGroup
672026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AntiAffinityGroup
682026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Instance
692026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = IpPool
702026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = InstanceNetworkInterface
712026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Vpc
722026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = VpcRouter
732026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = InternetGateway
742026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = InternetGatewayIpPool
752026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = InternetGatewayIpAddress
762026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = RouterRoute
772026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = VpcSubnet
782026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = FloatingIp
792026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = ExternalSubnet
802026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Image
812026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloImage
822026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AddressLot
832026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Blueprint
842026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = LoopbackAddress
852026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Certificate
862026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = ConsoleSession
872026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = DeviceAuthRequest
882026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = DeviceAccessToken
892026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = PhysicalDisk
902026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Rack
912026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SshKey
922026-03-03T18:55:01.449ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Silo
932026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloUser
942026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SiloGroup
952026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SupportBundle
962026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = IdentityProvider
972026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SamlIdentityProvider
982026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Sled
992026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = SubnetPool
1002026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = TufRepo
1012026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = TufArtifact
1022026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = TufTrustRoot
1032026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Alert
1042026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = AlertReceiver
1052026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = WebhookSecret
1062026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Zpool
1072026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = Service
1082026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = UserBuiltin
1092026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = ScimClientBearerToken
1102026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): registering Oso class class = MulticastGroup
1112026-03-03T18:55:01.450ZINFOtest_instance_metrics (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations; grants project.admin on all projects)\n# - silo.limited-collaborator (grants project.limited-collaborator on all projects)\n# - silo.viewer (can read most resources within the Silo; grants project.viewer)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project, including networking)\n# - project.limited-collaborator (can manage compute resources, but not networking resources)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\n# Note that certain Actors may not ever have any roles assigned to them, like\n# SCIM Actors.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif actor.is_user and silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t# Role hierarchy: admin > collaborator > limited-collaborator > viewer\n\t#\n\t# The "limited-collaborator" role can create/modify non-networking\n\t# resources (instances, disks, etc.) but cannot create/modify networking\n\t# infrastructure (VPCs, subnets, routers, internet gateways).\n\t# See nexus/authz-macros for InProjectLimited vs InProjectFull.\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "limited-collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"limited-collaborator" if "limited-collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_user and silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n}\n# We want to allow the user to modify the ssh key but disallow a SCIM IdP token\n# from doing the same.\nhas_permission(actor: AuthenticatedActor, "modify", ssh_key: SshKey)\n\tif actor.is_user and has_permission(actor, "modify", ssh_key.silo_user);\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource ScimClientBearerToken {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n # necessary to authenticate SCIM actors\n\t"read" if "external-authenticator" on "parent_fleet";\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token: ScimClientBearerToken)\n\tif scim_client_bearer_token.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerToken)\n\tif collection.silo.fleet = fleet;\n\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the quiesce state of a particular Nexus instance.\n#\n# These authz checks must not require the database. We grant this directly to\n# callers of the internal API.\nresource QuiesceState {\n\tpermissions = [ "read", "modify" ];\n}\nhas_permission(USER_INTERNAL_API: AuthenticatedActor, "read", _q: QuiesceState);\nhas_permission(\n USER_INTERNAL_API: AuthenticatedActor,\n "modify",\n _q: QuiesceState\n);\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/update/trust-roots" in the API\nresource UpdateTrustRootList {\n\tpermissions = [ "list_children", "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"list_children" if "viewer" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: UpdateTrustRootList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif actor.is_user and silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for accessing "/v1/multicast-groups" in the API\n# Groups are created when the first instance joins and deleted when the last leaves.\nresource MulticastGroupList {\n\tpermissions = [ "list_children" ];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet Viewers can list multicast groups\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group_list: MulticastGroupList)\n\tif multicast_group_list.fleet = fleet;\n\n# Any authenticated user can list multicast groups in their fleet.\n# This enables silo users to discover groups for attaching instances,\n# without requiring the Fleet::Viewer role.\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group_list: MulticastGroupList)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group_list.fleet;\n\n# MulticastGroup is a fleet-level discovery resource.\n# Join/leave authorization is gated by Instance::Modify, not the group itself.\nresource MulticastGroup {\n\tpermissions = [ "read", "list_children" ];\n\trelations = { parent_fleet: Fleet };\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group: MulticastGroup)\n\tif multicast_group.fleet = fleet;\n\n# Any authenticated user can read multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "read", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Any authenticated user can list members of multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Describes the policy for reading and writing the audit log\nresource AuditLog {\n\tpermissions = [\n\t "list_children", # retrieve audit log\n\t "create_child", # create audit log entry\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet viewers can read the audit log\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\n# Any actor should be able to write to the audit log because we need to be able\n# to write to the log from any request, authenticated or not. Audit log writes\n# are always a byproduct of other operations: there are no endpoints that allow\n# the user to write to the log deliberately. Note we use AuthenticatedActor\n# because we don't really mean unauthenticated -- in the case of login\n# operations, we use the external authenticator actor that creates the session\n# to authorize the audit log write.\nhas_permission(_actor: AuthenticatedActor, "create_child", _audit_log: AuditLog);\n\nhas_relation(fleet: Fleet, "parent_fleet", audit_log: AuditLog)\n\tif audit_log.fleet = fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Allow silo admins to delete and list user sessions\nresource SiloUserSessionList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's sessions.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's sessions.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserSessionList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own sessions\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Allow silo admins to delete and list user access tokens\nresource SiloUserTokenList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's tokens.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's tokens.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserTokenList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own tokens\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on users.\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_user_list: SiloUserList)\n\tif actor.is_scim_idp and silo_user_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_user: SiloUser)\n\tif actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_user_list: SiloUserList)\n if actor.is_scim_idp and silo_user_list.silo in actor.silo;\n\n# Describes the policy for creating and managing Silo groups (mostly intended\n# for API-managed groups)\nresource SiloGroupList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the groups in the\n\t# Silo) can see the groups in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's groups. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloGroupList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloGroupList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on groups.\nhas_permission(actor: AuthenticatedActor, "read", silo_group: SiloGroup)\n if actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_group_list: SiloGroupList)\n\tif actor.is_scim_idp and silo_group_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_group: SiloGroup)\n\tif actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_group_list: SiloGroupList)\n if actor.is_scim_idp and silo_group_list.silo in actor.silo;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest)\n if actor.is_user;\nhas_permission(actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest)\n if actor.is_user;\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_alert_receiver: AlertReceiver };\n\n\t"read" if "read" on "parent_alert_receiver";\n\t"modify" if "modify" on "parent_alert_receiver";\n}\n\nhas_relation(rx: AlertReceiver, "parent_alert_receiver", secret: WebhookSecret)\n\tif secret.alert_receiver = rx;\n\nresource AlertClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: AlertClassList)\n\tif collection.fleet = fleet;\n\nresource ScimClientBearerTokenList {\n\tpermissions = [ "create_child", "list_children" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n # These are all admin because being able to create these tokens would allow\n # a user to grant themselves admin by modifying group membership through SCIM calls\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_silo";\n\n # Fleet-level roles also grant privileges for SCIM client tokens, for\n # configuration before silo admins are present.\n\t"create_child" if "admin" on "parent_fleet";\n\t"list_children" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token_list: ScimClientBearerTokenList)\n\tif scim_client_bearer_token_list.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerTokenList)\n\tif collection.silo.fleet = fleet;\n\n# VpcList is a synthetic resource for controlling VPC creation.\n# Unlike other project resources, VPC creation requires the full "collaborator"\n# role rather than "limited-collaborator", enforcing the networking restriction.\n# This allows organizations to restrict who can reconfigure the network topology\n# while still allowing users with limited-collaborator to work with compute\n# resources (instances, disks, etc.) within the existing network.\nresource VpcList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { containing_project: Project };\n\n\t"list_children" if "read" on "containing_project";\n\t"create_child" if "collaborator" on "containing_project";\n}\nhas_relation(project: Project, "containing_project", collection: VpcList)\n\tif collection.project = project;\n\n# Describes the policy for accessing "/v1/system/subnet-pools" in the API\nresource SubnetPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the Subnet Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list External Subnet Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", subnet_pool_list: SubnetPoolList)\n\tif subnet_pool_list.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource ExternalSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ExternalSubnet)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource SubnetPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SubnetPool)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource TufTrustRoot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufTrustRoot)\n if child.fleet = fleet;\n \n\n resource Alert {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Alert)\n if child.fleet = fleet;\n \n\n resource AlertReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AlertReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n \n\n
1122026-03-03T18:55:01.462ZINFOtest_instance_metrics (ServerContext): Setting up resolver using DNS address: [::1]:57905
1132026-03-03T18:55:01.462ZINFOtest_instance_metrics (DnsResolver): new DNS resolver addresses = [[::1]:57905]
1142026-03-03T18:55:01.462ZINFOtest_instance_metrics (ServerContext): Setting up qorb database pool from a single host url = PostgresConfigWithUrl {\n url_raw: "postgresql://root@[::1]:41875/omicron?sslmode=disable",\n config: Config {\n user: Some(\n "root",\n ),\n password: None,\n dbname: Some(\n "omicron",\n ),\n options: None,\n application_name: None,\n ssl_mode: Disable,\n host: [\n Tcp(\n "::1",\n ),\n ],\n hostaddr: [],\n port: [\n 41875,\n ],\n connect_timeout: None,\n tcp_user_timeout: None,\n keepalives: true,\n keepalives_idle: 7200s,\n keepalives_interval: None,\n keepalives_retries: None,\n target_session_attrs: Any,\n channel_binding: Prefer,\n load_balance_hosts: Disable,\n },\n}
1152026-03-03T18:55:01.462ZDEBGtest_instance_metrics (ServerContext): registered USDT probes
1162026-03-03T18:55:01.701ZINFOtest_instance_metrics (datastore): Database schema version is up to date desired_version = 233.0.0 found_version = 233.0.0
1172026-03-03T18:55:01.705ZWARNtest_instance_metrics (datastore): No db_metadata_nexus records exist - skipping access check explanation = This is expected during initial deployment or before migration nexus_id = 913233fe-92a8-4635-9572-183f495429c4 (omicron_zone)
1182026-03-03T18:55:01.706ZINFOtest_instance_metrics (nexus): Datastore is ready for usage
1192026-03-03T18:55:01.733ZDEBGtest_instance_metrics (clickhouse-client): registered USDT probes id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9
1202026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
1212026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
1222026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1232026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1242026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1252026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1262026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = PUT path = /disks/{disk_id} versions = all
1272026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /metrics/collectors versions = all
1282026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1292026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /metrics/producers versions = all
1302026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1312026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = GET path = /probes/{sled} versions = all
1322026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /refresh-vpc-routes versions = all
1332026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = GET path = /sled-agents/{sled_id} versions = all
1342026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /sled-agents/{sled_id} versions = all
1352026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = PUT path = /switch/{switch_id} versions = all
1362026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = GET path = /v1/ping versions = all
1372026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = PUT path = /vmms/{propolis_id} versions = all
1382026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): registered endpoint local_addr = 127.0.0.1:33727 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1392026-03-03T18:55:01.743ZINFOtest_instance_metrics (dropshot_internal): listening local_addr = 127.0.0.1:33727
1402026-03-03T18:55:01.743ZDEBGtest_instance_metrics (dropshot_internal): successfully registered DTrace USDT probes local_addr = 127.0.0.1:33727
1412026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /bgtasks versions = all
1422026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /bgtasks/activate versions = all
1432026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /bgtasks/view/{bgtask_name} versions = all
1442026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /clickhouse/policy versions = all
1452026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /clickhouse/policy versions = all
1462026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /debug/fetch-omdb-binary versions = all
1472026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /demo-saga versions = all
1482026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1492026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /deployment/blueprints/all versions = all
1502026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1512026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1522026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /deployment/blueprints/import versions = all
1532026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /deployment/blueprints/regenerate versions = all
1542026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /deployment/blueprints/target versions = all
1552026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /deployment/blueprints/target versions = all
1562026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = PUT path = /deployment/blueprints/target/enabled versions = all
1572026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /deployment/reconfigurator-config versions = all
1582026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /deployment/reconfigurator-config versions = all
1592026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /deployment/reconfigurator-config/{version} versions = all
1602026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /deployment/update-status versions = all
1612026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /experimental/v1/system/support-bundles versions = all
1622026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /experimental/v1/system/support-bundles versions = all
1632026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1642026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1652026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1662026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1672026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1682026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1692026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1702026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
1712026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /instances/{instance_id}/migrate versions = all
1722026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /mgs-updates versions = all
1732026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /oximeter/read-policy versions = all
1742026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /oximeter/read-policy versions = all
1752026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /physical-disk/expunge versions = all
1762026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /quiesce versions = all
1772026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /quiesce versions = all
1782026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1792026-03-03T18:55:01.744ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /sagas versions = all
1802026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /sagas/{saga_id} versions = all
1812026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /sleds/expunge versions = all
1822026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /sleds/uninitialized versions = all
1832026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /trust-quorum/config/{rack_id} versions = all
1842026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /trust-quorum/lrtq-upgrade versions = all
1852026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = POST path = /trust-quorum/remove/{sled} versions = all
1862026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): registered endpoint local_addr = 127.0.0.1:43143 method = GET path = /v1/ping versions = all
1872026-03-03T18:55:01.745ZINFOtest_instance_metrics (dropshot_lockstep): listening local_addr = 127.0.0.1:43143
1882026-03-03T18:55:01.745ZDEBGtest_instance_metrics (dropshot_lockstep): successfully registered DTrace USDT probes local_addr = 127.0.0.1:43143
1892026-03-03T18:55:01.745ZINFOtest_instance_metrics (SEC): SEC running sec_id = 913233fe-92a8-4635-9572-183f495429c4
1902026-03-03T18:55:01.745ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
1912026-03-03T18:55:01.745ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
1922026-03-03T18:55:01.749ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
1932026-03-03T18:55:01.749ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in users
1942026-03-03T18:55:01.749ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
1952026-03-03T18:55:01.749ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
1962026-03-03T18:55:01.749ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
1972026-03-03T18:55:01.802ZINFOtest_instance_metrics (MgsUpdateDriver): starting MgsUpdateDriver
1982026-03-03T18:55:01.802ZTRACtest_instance_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 32 49 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 2I..........._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:58061 req_id = 95c974f5-86a1-48d1-a220-e55634c4b316
1992026-03-03T18:55:01.807ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 12873,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:58061 req_id = 95c974f5-86a1-48d1-a220-e55634c4b316
2002026-03-03T18:55:01.808ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 12873, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:58061 req_id = 95c974f5-86a1-48d1-a220-e55634c4b316
2012026-03-03T18:55:01.808ZTRACtest_instance_metrics (dns): buffer buffer = Length: 74 (0x4a) bytes\n0000: 29 f7 01 00 00 01 00 00 00 00 00 01 0b 5f 72 65 )............_re\n0010: 70 6f 2d 64 65 70 6f 74 04 5f 74 63 70 0d 63 6f po-depot._tcp.co\n0020: 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 ntrol-plane.oxid\n0030: 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 e.internal..!...\n0040: 00 29 04 d0 00 00 00 00 00 00 .)........ kind = dns peer_addr = [::1]:58988 req_id = 32910ced-396f-46ad-bd68-c3c46329f14f
2022026-03-03T18:55:01.808ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 10743,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_repo-depot._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_repo-depot._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 11,\n 95,\n 114,\n 101,\n 112,\n 111,\n 45,\n 100,\n 101,\n 112,\n 111,\n 116,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:58988 req_id = 32910ced-396f-46ad-bd68-c3c46329f14f
2032026-03-03T18:55:01.808ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 10743, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_repo-depot._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_repo-depot._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 11, 95, 114, 101, 112, 111, 45, 100, 101, 112, 111, 116, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_repo-depot._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:58988 req_id = 32910ced-396f-46ad-bd68-c3c46329f14f
2042026-03-03T18:55:01.808ZTRACtest_instance_metrics (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 3d 8a 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 =............_cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:60672 req_id = 88423009-305f-47e1-aa8f-b0a59f5d2b3f
2052026-03-03T18:55:01.808ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 15754,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:60672 req_id = 88423009-305f-47e1-aa8f-b0a59f5d2b3f
2062026-03-03T18:55:01.808ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 15754, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_crucible-pantry._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 16, 95, 99, 114, 117, 99, 105, 98, 108, 101, 45, 112, 97, 110, 116, 114, 121, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_crucible-pantry._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:60672 req_id = 88423009-305f-47e1-aa8f-b0a59f5d2b3f
2072026-03-03T18:55:01.808ZINFOtest_instance_metrics (DataLoader): created 5 built-in users
2082026-03-03T18:55:01.808ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2092026-03-03T18:55:01.808ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2102026-03-03T18:55:01.808ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2112026-03-03T18:55:01.808ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in role assignments
2122026-03-03T18:55:01.808ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2132026-03-03T18:55:01.808ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2142026-03-03T18:55:01.808ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2152026-03-03T18:55:01.915ZINFOtest_instance_metrics (DataLoader): created 4 built-in role assignments
2162026-03-03T18:55:01.915ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2172026-03-03T18:55:01.915ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2182026-03-03T18:55:01.916ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2192026-03-03T18:55:01.918ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in silos
2202026-03-03T18:55:01.918ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2212026-03-03T18:55:01.918ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2222026-03-03T18:55:01.918ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2232026-03-03T18:55:01.967ZINFOtest_instance_metrics (DataLoader): created 2 built-in silos
2242026-03-03T18:55:01.967ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2252026-03-03T18:55:01.967ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2262026-03-03T18:55:01.968ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2272026-03-03T18:55:02.003ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2282026-03-03T18:55:02.003ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2292026-03-03T18:55:02.004ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2302026-03-03T18:55:02.004ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in projects
2312026-03-03T18:55:02.004ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2322026-03-03T18:55:02.004ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2332026-03-03T18:55:02.005ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2342026-03-03T18:55:02.009ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2352026-03-03T18:55:02.009ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2362026-03-03T18:55:02.009ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2372026-03-03T18:55:02.009ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2382026-03-03T18:55:02.009ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2392026-03-03T18:55:02.034ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2402026-03-03T18:55:02.034ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2412026-03-03T18:55:02.034ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2422026-03-03T18:55:02.034ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2432026-03-03T18:55:02.036ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2442026-03-03T18:55:02.038ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2452026-03-03T18:55:02.038ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }
2462026-03-03T18:55:02.038ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2472026-03-03T18:55:02.038ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2482026-03-03T18:55:02.038ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2492026-03-03T18:55:02.038ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2502026-03-03T18:55:02.039ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2512026-03-03T18:55:02.039ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2522026-03-03T18:55:02.039ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2532026-03-03T18:55:02.040ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2542026-03-03T18:55:02.041ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2552026-03-03T18:55:02.043ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2562026-03-03T18:55:02.043ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2572026-03-03T18:55:02.043ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2582026-03-03T18:55:02.043ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2592026-03-03T18:55:02.050ZINFOtest_instance_metrics (DataLoader): created built-in services project
2602026-03-03T18:55:02.050ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2612026-03-03T18:55:02.050ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2622026-03-03T18:55:02.051ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2632026-03-03T18:55:02.051ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in VPCs
2642026-03-03T18:55:02.051ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2652026-03-03T18:55:02.051ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2662026-03-03T18:55:02.051ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2672026-03-03T18:55:02.053ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2682026-03-03T18:55:02.053ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2692026-03-03T18:55:02.053ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2702026-03-03T18:55:02.055ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2712026-03-03T18:55:02.055ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2722026-03-03T18:55:02.055ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2732026-03-03T18:55:02.055ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2742026-03-03T18:55:02.055ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2752026-03-03T18:55:02.059ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2762026-03-03T18:55:02.059ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2772026-03-03T18:55:02.059ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2782026-03-03T18:55:02.060ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2792026-03-03T18:55:02.061ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2802026-03-03T18:55:02.061ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2812026-03-03T18:55:02.061ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2822026-03-03T18:55:02.062ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2832026-03-03T18:55:02.063ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2842026-03-03T18:55:02.067ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2852026-03-03T18:55:02.067ZTRACtest_instance_metrics (DataLoader): successful lookup of siloed resource "Project" using built-in user
2862026-03-03T18:55:02.067ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }
2872026-03-03T18:55:02.067ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
2882026-03-03T18:55:02.067ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2892026-03-03T18:55:02.067ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2902026-03-03T18:55:02.067ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2912026-03-03T18:55:02.072ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
2922026-03-03T18:55:02.072ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2932026-03-03T18:55:02.072ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2942026-03-03T18:55:02.073ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2952026-03-03T18:55:02.083ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
2962026-03-03T18:55:02.083ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
2972026-03-03T18:55:02.083ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
2982026-03-03T18:55:02.084ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
2992026-03-03T18:55:02.088ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3002026-03-03T18:55:02.092ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
3012026-03-03T18:55:02.092ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3022026-03-03T18:55:02.092ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3032026-03-03T18:55:02.092ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3042026-03-03T18:55:02.097ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3052026-03-03T18:55:02.097ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3062026-03-03T18:55:02.097ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3072026-03-03T18:55:02.097ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3082026-03-03T18:55:02.097ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3092026-03-03T18:55:02.099ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3102026-03-03T18:55:02.099ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3112026-03-03T18:55:02.099ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3122026-03-03T18:55:02.099ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3132026-03-03T18:55:02.100ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3142026-03-03T18:55:02.101ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3152026-03-03T18:55:02.101ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3162026-03-03T18:55:02.101ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3172026-03-03T18:55:02.102ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3182026-03-03T18:55:02.105ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3192026-03-03T18:55:02.106ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3202026-03-03T18:55:02.106ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3212026-03-03T18:55:02.106ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3222026-03-03T18:55:02.109ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3232026-03-03T18:55:02.109ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3242026-03-03T18:55:02.109ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3252026-03-03T18:55:02.112ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3262026-03-03T18:55:02.112ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3272026-03-03T18:55:02.112ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3282026-03-03T18:55:02.113ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }
3292026-03-03T18:55:02.113ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3302026-03-03T18:55:02.113ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3312026-03-03T18:55:02.113ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3322026-03-03T18:55:02.114ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3332026-03-03T18:55:02.120ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3342026-03-03T18:55:02.120ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3352026-03-03T18:55:02.120ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3362026-03-03T18:55:02.121ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3372026-03-03T18:55:02.122ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3382026-03-03T18:55:02.122ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3392026-03-03T18:55:02.122ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3402026-03-03T18:55:02.122ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3412026-03-03T18:55:02.123ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3422026-03-03T18:55:02.127ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
3432026-03-03T18:55:02.127ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3442026-03-03T18:55:02.127ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3452026-03-03T18:55:02.127ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3462026-03-03T18:55:02.156ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3472026-03-03T18:55:02.156ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3482026-03-03T18:55:02.156ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3492026-03-03T18:55:02.156ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3502026-03-03T18:55:02.156ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3512026-03-03T18:55:02.158ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3522026-03-03T18:55:02.158ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3532026-03-03T18:55:02.158ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3542026-03-03T18:55:02.158ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3552026-03-03T18:55:02.159ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3562026-03-03T18:55:02.159ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3572026-03-03T18:55:02.159ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3582026-03-03T18:55:02.159ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3592026-03-03T18:55:02.160ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3602026-03-03T18:55:02.164ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3612026-03-03T18:55:02.164ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3622026-03-03T18:55:02.164ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3632026-03-03T18:55:02.165ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3642026-03-03T18:55:02.207ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
3652026-03-03T18:55:02.207ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3662026-03-03T18:55:02.207ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3672026-03-03T18:55:02.207ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3682026-03-03T18:55:02.207ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3692026-03-03T18:55:02.209ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3702026-03-03T18:55:02.209ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3712026-03-03T18:55:02.209ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3722026-03-03T18:55:02.209ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3732026-03-03T18:55:02.211ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
3742026-03-03T18:55:02.211ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3752026-03-03T18:55:02.211ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3762026-03-03T18:55:02.212ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3772026-03-03T18:55:02.213ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3782026-03-03T18:55:02.217ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3792026-03-03T18:55:02.217ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3802026-03-03T18:55:02.217ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3812026-03-03T18:55:02.217ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3822026-03-03T18:55:02.223ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in VPC firewall rules
3832026-03-03T18:55:02.223ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3842026-03-03T18:55:02.224ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3852026-03-03T18:55:02.224ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3862026-03-03T18:55:02.233ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3872026-03-03T18:55:02.233ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3882026-03-03T18:55:02.233ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3892026-03-03T18:55:02.236ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3902026-03-03T18:55:02.237ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3912026-03-03T18:55:02.237ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3922026-03-03T18:55:02.237ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
3932026-03-03T18:55:02.237ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
3942026-03-03T18:55:02.237ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3952026-03-03T18:55:02.237ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
3962026-03-03T18:55:02.238ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
3972026-03-03T18:55:02.239ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
3982026-03-03T18:55:02.240ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
3992026-03-03T18:55:02.240ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4002026-03-03T18:55:02.240ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4012026-03-03T18:55:02.240ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4022026-03-03T18:55:02.240ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4032026-03-03T18:55:02.240ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4042026-03-03T18:55:02.241ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4052026-03-03T18:55:02.242ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4062026-03-03T18:55:02.245ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4072026-03-03T18:55:02.245ZTRACtest_instance_metrics (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4082026-03-03T18:55:02.245ZTRACtest_instance_metrics (DataLoader): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4092026-03-03T18:55:02.245ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4102026-03-03T18:55:02.245ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4112026-03-03T18:55:02.245ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4122026-03-03T18:55:02.246ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4132026-03-03T18:55:02.247ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4142026-03-03T18:55:02.247ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4152026-03-03T18:55:02.247ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4162026-03-03T18:55:02.247ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4172026-03-03T18:55:02.248ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4182026-03-03T18:55:02.249ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4192026-03-03T18:55:02.249ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4202026-03-03T18:55:02.249ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4212026-03-03T18:55:02.250ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4222026-03-03T18:55:02.254ZDEBGtest_instance_metrics (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4232026-03-03T18:55:02.255ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4242026-03-03T18:55:02.255ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4252026-03-03T18:55:02.255ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4262026-03-03T18:55:02.258ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4272026-03-03T18:55:02.258ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4282026-03-03T18:55:02.259ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4292026-03-03T18:55:02.259ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4302026-03-03T18:55:02.259ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4312026-03-03T18:55:02.260ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4322026-03-03T18:55:02.260ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4332026-03-03T18:55:02.260ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4342026-03-03T18:55:02.261ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4352026-03-03T18:55:02.262ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4362026-03-03T18:55:02.262ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4372026-03-03T18:55:02.262ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4382026-03-03T18:55:02.263ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4392026-03-03T18:55:02.264ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4402026-03-03T18:55:02.267ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4412026-03-03T18:55:02.267ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4422026-03-03T18:55:02.267ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4432026-03-03T18:55:02.268ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4442026-03-03T18:55:02.327ZINFOtest_instance_metrics (DataLoader): created built-in VPC firewall rules
4452026-03-03T18:55:02.328ZDEBGtest_instance_metrics (DataLoader): attempting to create built-in VPC Subnets
4462026-03-03T18:55:02.328ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4472026-03-03T18:55:02.328ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4482026-03-03T18:55:02.328ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4492026-03-03T18:55:02.329ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4502026-03-03T18:55:02.329ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4512026-03-03T18:55:02.329ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4522026-03-03T18:55:02.331ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4532026-03-03T18:55:02.331ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4542026-03-03T18:55:02.331ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4552026-03-03T18:55:02.332ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4562026-03-03T18:55:02.333ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4572026-03-03T18:55:02.333ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4582026-03-03T18:55:02.333ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4592026-03-03T18:55:02.333ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4602026-03-03T18:55:02.334ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4612026-03-03T18:55:02.334ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4622026-03-03T18:55:02.334ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4632026-03-03T18:55:02.335ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4642026-03-03T18:55:02.336ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4652026-03-03T18:55:02.336ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4662026-03-03T18:55:02.336ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4672026-03-03T18:55:02.337ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4682026-03-03T18:55:02.338ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4692026-03-03T18:55:02.341ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4702026-03-03T18:55:02.342ZTRACtest_instance_metrics (DataLoader): successful lookup of siloed resource "Vpc" using built-in user
4712026-03-03T18:55:02.342ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4722026-03-03T18:55:02.342ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4732026-03-03T18:55:02.342ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4742026-03-03T18:55:02.345ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
4752026-03-03T18:55:02.345ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4762026-03-03T18:55:02.345ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4772026-03-03T18:55:02.345ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4782026-03-03T18:55:02.345ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4792026-03-03T18:55:02.346ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4802026-03-03T18:55:02.346ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4812026-03-03T18:55:02.346ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4822026-03-03T18:55:02.347ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4832026-03-03T18:55:02.348ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4842026-03-03T18:55:02.348ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4852026-03-03T18:55:02.348ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4862026-03-03T18:55:02.348ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4872026-03-03T18:55:02.349ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4882026-03-03T18:55:02.353ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4892026-03-03T18:55:02.359ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
4902026-03-03T18:55:02.359ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
4912026-03-03T18:55:02.359ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4922026-03-03T18:55:02.359ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4932026-03-03T18:55:02.359ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4942026-03-03T18:55:02.360ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
4952026-03-03T18:55:02.360ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
4962026-03-03T18:55:02.360ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
4972026-03-03T18:55:02.361ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
4982026-03-03T18:55:02.364ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
4992026-03-03T18:55:02.364ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5002026-03-03T18:55:02.364ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5012026-03-03T18:55:02.365ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5022026-03-03T18:55:02.366ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5032026-03-03T18:55:02.371ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5042026-03-03T18:55:02.371ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5052026-03-03T18:55:02.371ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5062026-03-03T18:55:02.371ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5072026-03-03T18:55:02.413ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5082026-03-03T18:55:02.413ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5092026-03-03T18:55:02.414ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5102026-03-03T18:55:02.415ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5112026-03-03T18:55:02.415ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5122026-03-03T18:55:02.416ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5132026-03-03T18:55:02.416ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5142026-03-03T18:55:02.416ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5152026-03-03T18:55:02.420ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5162026-03-03T18:55:02.420ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5172026-03-03T18:55:02.420ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5182026-03-03T18:55:02.420ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5192026-03-03T18:55:02.422ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5202026-03-03T18:55:02.422ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5212026-03-03T18:55:02.422ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5222026-03-03T18:55:02.422ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5232026-03-03T18:55:02.423ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5242026-03-03T18:55:02.427ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5252026-03-03T18:55:02.430ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5262026-03-03T18:55:02.430ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5272026-03-03T18:55:02.430ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5282026-03-03T18:55:02.430ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5292026-03-03T18:55:02.430ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5302026-03-03T18:55:02.432ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5312026-03-03T18:55:02.432ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5322026-03-03T18:55:02.432ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5332026-03-03T18:55:02.432ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5342026-03-03T18:55:02.433ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5352026-03-03T18:55:02.433ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5362026-03-03T18:55:02.433ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5372026-03-03T18:55:02.434ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5382026-03-03T18:55:02.435ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5392026-03-03T18:55:02.439ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5402026-03-03T18:55:02.439ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5412026-03-03T18:55:02.439ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5422026-03-03T18:55:02.440ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5432026-03-03T18:55:02.443ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5442026-03-03T18:55:02.444ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5452026-03-03T18:55:02.444ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5462026-03-03T18:55:02.445ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
5472026-03-03T18:55:02.445ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5482026-03-03T18:55:02.445ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5492026-03-03T18:55:02.445ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5502026-03-03T18:55:02.446ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5512026-03-03T18:55:02.447ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5522026-03-03T18:55:02.447ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5532026-03-03T18:55:02.447ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5542026-03-03T18:55:02.447ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5552026-03-03T18:55:02.448ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5562026-03-03T18:55:02.448ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5572026-03-03T18:55:02.448ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5582026-03-03T18:55:02.449ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5592026-03-03T18:55:02.450ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5602026-03-03T18:55:02.453ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5612026-03-03T18:55:02.456ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) }
5622026-03-03T18:55:02.456ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
5632026-03-03T18:55:02.456ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5642026-03-03T18:55:02.456ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5652026-03-03T18:55:02.456ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5662026-03-03T18:55:02.458ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
5672026-03-03T18:55:02.458ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5682026-03-03T18:55:02.458ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5692026-03-03T18:55:02.459ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5702026-03-03T18:55:02.460ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
5712026-03-03T18:55:02.460ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5722026-03-03T18:55:02.460ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5732026-03-03T18:55:02.461ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5742026-03-03T18:55:02.462ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5752026-03-03T18:55:02.466ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
5762026-03-03T18:55:02.466ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5772026-03-03T18:55:02.466ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5782026-03-03T18:55:02.467ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5792026-03-03T18:55:02.473ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5802026-03-03T18:55:02.473ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5812026-03-03T18:55:02.473ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5822026-03-03T18:55:02.478ZINFOtest_instance_metrics (DataLoader): created built-in services vpc subnets
5832026-03-03T18:55:02.478ZINFOtest_instance_metrics (DataLoader): created built-in services vpc
5842026-03-03T18:55:02.478ZTRACtest_instance_metrics (DataLoader): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5852026-03-03T18:55:02.478ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5862026-03-03T18:55:02.480ZDEBGtest_instance_metrics (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5872026-03-03T18:55:02.480ZDEBGtest_instance_metrics (DataLoader): attempting to create silo users
5882026-03-03T18:55:02.480ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5892026-03-03T18:55:02.480ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5902026-03-03T18:55:02.480ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5912026-03-03T18:55:02.515ZINFOtest_instance_metrics (DataLoader): created 2 silo users
5922026-03-03T18:55:02.515ZDEBGtest_instance_metrics (DataLoader): attempting to create silo user role assignments
5932026-03-03T18:55:02.515ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5942026-03-03T18:55:02.515ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5952026-03-03T18:55:02.516ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
5962026-03-03T18:55:02.518ZINFOtest_instance_metrics (DataLoader): created 2 silo user role assignments
5972026-03-03T18:55:02.518ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
5982026-03-03T18:55:02.518ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
5992026-03-03T18:55:02.519ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6002026-03-03T18:55:02.521ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6012026-03-03T18:55:02.521ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6022026-03-03T18:55:02.522ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6032026-03-03T18:55:02.533ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList
6042026-03-03T18:55:02.533ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6052026-03-03T18:55:02.533ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6062026-03-03T18:55:02.533ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6072026-03-03T18:55:02.534ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6082026-03-03T18:55:02.536ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6092026-03-03T18:55:02.537ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList result = Ok(())
6102026-03-03T18:55:02.537ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6112026-03-03T18:55:02.537ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6122026-03-03T18:55:02.537ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6132026-03-03T18:55:02.619ZTRACtest_instance_metrics (DataLoader): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList
6142026-03-03T18:55:02.619ZTRACtest_instance_metrics (DataLoader): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6152026-03-03T18:55:02.619ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6162026-03-03T18:55:02.619ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6172026-03-03T18:55:02.619ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6182026-03-03T18:55:02.622ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6192026-03-03T18:55:02.623ZDEBGtest_instance_metrics (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = IpPoolList result = Ok(())
6202026-03-03T18:55:02.623ZTRACtest_instance_metrics (DataLoader): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database
6212026-03-03T18:55:02.623ZDEBGtest_instance_metrics (DataLoader): roles roles = RoleSet { roles: {} }
6222026-03-03T18:55:02.624ZDEBGtest_instance_metrics (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001 (built_in_user), .. }) resource = Database result = Ok(())
6232026-03-03T18:55:02.625ZINFOtest_instance_metrics (nexus): populate complete
6242026-03-03T18:55:02.625ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
6252026-03-03T18:55:02.625ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6262026-03-03T18:55:02.625ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
6272026-03-03T18:55:02.625ZDEBGtest_instance_metrics (BackgroundTasks): roles roles = RoleSet { roles: {} }
6282026-03-03T18:55:02.626ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
6292026-03-03T18:55:02.637ZDEBGtest_instance_metrics (init_with_steps): Running step start_gateway_switch0
6302026-03-03T18:55:02.637ZDEBGtest_instance_metrics: Starting Management Gateway
6312026-03-03T18:55:02.674ZDEBGtest_instance_metrics (BackgroundTasks): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322026-03-03T18:55:02.677ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
6332026-03-03T18:55:02.677ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
6342026-03-03T18:55:02.677ZDEBGtest_instance_metrics (BackgroundTasks): roles roles = RoleSet { roles: {} }
6352026-03-03T18:55:02.678ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
6362026-03-03T18:55:02.684ZINFOtest_instance_metrics (nexus): activating background tasks
6372026-03-03T18:55:02.684ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
6382026-03-03T18:55:02.684ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6392026-03-03T18:55:02.684ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
6402026-03-03T18:55:02.684ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6412026-03-03T18:55:02.684ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6422026-03-03T18:55:02.684ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
6432026-03-03T18:55:02.684ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
6442026-03-03T18:55:02.684ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
6452026-03-03T18:55:02.684ZWARNtest_instance_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config nor servers
6462026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 41.38\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6472026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
6482026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6492026-03-03T18:55:02.685ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
6502026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6512026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6522026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
6532026-03-03T18:55:02.685ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
6542026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
6552026-03-03T18:55:02.685ZWARNtest_instance_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config nor servers
6562026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 21.27\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
6572026-03-03T18:55:02.685ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
6582026-03-03T18:55:02.686ZINFOtest_instance_metrics (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2026-03-03 18:45:02.685995184 UTC
6592026-03-03T18:55:02.686ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database
6602026-03-03T18:55:02.686ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6612026-03-03T18:55:02.687ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6622026-03-03T18:55:02.687ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
6632026-03-03T18:55:02.687ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
6642026-03-03T18:55:02.687ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6652026-03-03T18:55:02.688ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
6662026-03-03T18:55:02.688ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6672026-03-03T18:55:02.688ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
6682026-03-03T18:55:02.689ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = nat_garbage_collector iteration = 1 reason = Timeout
6692026-03-03T18:55:02.689ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database
6702026-03-03T18:55:02.689ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = nat_garbage_collector roles = RoleSet { roles: {} }
6712026-03-03T18:55:02.689ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = nat_garbage_collector resource = Database result = Ok(())
6722026-03-03T18:55:02.689ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
6732026-03-03T18:55:02.689ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database
6742026-03-03T18:55:02.689ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6752026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = bfd_manager resource = Database result = Ok(())
6762026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
6772026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
6782026-03-03T18:55:02.690ZWARNtest_instance_metrics (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = no blueprint
6792026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.39\u{b5}s iteration = 1 status = {"error":"no blueprint"}
6802026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
6812026-03-03T18:55:02.690ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
6822026-03-03T18:55:02.690ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6832026-03-03T18:55:02.690ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
6842026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6852026-03-03T18:55:02.690ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
6862026-03-03T18:55:02.691ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 1 reason = Timeout
6872026-03-03T18:55:02.691ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
6882026-03-03T18:55:02.691ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6892026-03-03T18:55:02.691ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
6902026-03-03T18:55:02.691ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
6912026-03-03T18:55:02.691ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
6922026-03-03T18:55:02.691ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 1 reason = Timeout
6932026-03-03T18:55:02.691ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
6942026-03-03T18:55:02.691ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
6952026-03-03T18:55:02.691ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
6962026-03-03T18:55:02.691ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
6972026-03-03T18:55:02.691ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
6982026-03-03T18:55:02.693ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 1 reason = Timeout
6992026-03-03T18:55:02.693ZDEBGtest_instance_metrics (BackgroundTasks): reconfigurator config not yet loaded; doing nothing background_task = blueprint_planner
7002026-03-03T18:55:02.693ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 30.6\u{b5}s iteration = 1 status = "Disabled"
7012026-03-03T18:55:02.693ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
7022026-03-03T18:55:02.693ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig
7032026-03-03T18:55:02.693ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7042026-03-03T18:55:02.694ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
7052026-03-03T18:55:02.694ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7062026-03-03T18:55:02.694ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
7072026-03-03T18:55:02.694ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
7082026-03-03T18:55:02.694ZWARNtest_instance_metrics (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector reason = no blueprint
7092026-03-03T18:55:02.694ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 20.57\u{b5}s iteration = 1 status = {"error":"no blueprint"}
7102026-03-03T18:55:02.694ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
7112026-03-03T18:55:02.694ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet
7122026-03-03T18:55:02.694ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7132026-03-03T18:55:02.694ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
7142026-03-03T18:55:02.694ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7152026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7162026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
7172026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 13.66\u{b5}s iteration = 1 status = {"error":"task disabled"}
7182026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
7192026-03-03T18:55:02.695ZWARNtest_instance_metrics (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous reason = no blueprint
7202026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 10.6\u{b5}s iteration = 1 status = {"error":"no blueprint"}
7212026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
7222026-03-03T18:55:02.695ZINFOtest_instance_metrics (BackgroundTasks): Decommissioned Disk Cleaner disabled background_task = decommissioned_disk_cleaner
7232026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 16.16\u{b5}s iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7242026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
7252026-03-03T18:55:02.695ZWARNtest_instance_metrics (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker
7262026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 9.44\u{b5}s iteration = 1 status = {"error":"inventory collection is None"}
7272026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
7282026-03-03T18:55:02.695ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet
7292026-03-03T18:55:02.695ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = switch_port_config_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7302026-03-03T18:55:02.695ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database
7312026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7322026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7332026-03-03T18:55:02.695ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
7342026-03-03T18:55:02.696ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
7352026-03-03T18:55:02.696ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7362026-03-03T18:55:02.696ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
7372026-03-03T18:55:02.696ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
7382026-03-03T18:55:02.696ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database
7392026-03-03T18:55:02.696ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7402026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
7412026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
7422026-03-03T18:55:02.697ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database
7432026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7442026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7452026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
7462026-03-03T18:55:02.697ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet
7472026-03-03T18:55:02.697ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = instance_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7482026-03-03T18:55:02.697ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database
7492026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7502026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
7512026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
7522026-03-03T18:55:02.697ZINFOtest_instance_metrics (BackgroundTasks): background instance updater explicitly disabled background_task = instance_updater
7532026-03-03T18:55:02.697ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.1\u{b5}s iteration = 1 status = {"destroyed_active_vmms":0,"disabled":true,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7542026-03-03T18:55:02.698ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
7552026-03-03T18:55:02.698ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7562026-03-03T18:55:02.698ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
7572026-03-03T18:55:02.698ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7582026-03-03T18:55:02.698ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7592026-03-03T18:55:02.698ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
7602026-03-03T18:55:02.698ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database
7612026-03-03T18:55:02.698ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7622026-03-03T18:55:02.698ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7632026-03-03T18:55:02.699ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
7642026-03-03T18:55:02.699ZDEBGtest_instance_metrics (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
7652026-03-03T18:55:02.699ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
7662026-03-03T18:55:02.699ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7672026-03-03T18:55:02.699ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7682026-03-03T18:55:02.699ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
7692026-03-03T18:55:02.699ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
7702026-03-03T18:55:02.699ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
7712026-03-03T18:55:02.699ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
7722026-03-03T18:55:02.699ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
7732026-03-03T18:55:02.699ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7742026-03-03T18:55:02.699ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7752026-03-03T18:55:02.700ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
7762026-03-03T18:55:02.700ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database
7772026-03-03T18:55:02.700ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
7782026-03-03T18:55:02.700ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7792026-03-03T18:55:02.700ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
7802026-03-03T18:55:02.700ZINFOtest_instance_metrics (SagaQuiesceHandle): saga recovery pass starting
7812026-03-03T18:55:02.700ZDEBGtest_instance_metrics (SagaRecoverer): listing candidate sagas for recovery
7822026-03-03T18:55:02.700ZTRACtest_instance_metrics (SagaRecoverer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database
7832026-03-03T18:55:02.700ZDEBGtest_instance_metrics (SagaRecoverer): roles roles = RoleSet { roles: {} }
7842026-03-03T18:55:02.700ZDEBGtest_instance_metrics (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a (built_in_user), .. }) resource = Database result = Ok(())
7852026-03-03T18:55:02.701ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
7862026-03-03T18:55:02.701ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database
7872026-03-03T18:55:02.701ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
7882026-03-03T18:55:02.701ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = lookup_region_port resource = Database result = Ok(())
7892026-03-03T18:55:02.701ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
7902026-03-03T18:55:02.701ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database
7912026-03-03T18:55:02.701ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7922026-03-03T18:55:02.701ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7932026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
7942026-03-03T18:55:02.702ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database
7952026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7962026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7972026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
7982026-03-03T18:55:02.702ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
7992026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8002026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8012026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
8022026-03-03T18:55:02.702ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database
8032026-03-03T18:55:02.702ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8042026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8052026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
8062026-03-03T18:55:02.703ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
8072026-03-03T18:55:02.703ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8082026-03-03T18:55:02.703ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
8092026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8102026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8112026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 1 reason = Timeout
8122026-03-03T18:55:02.703ZINFOtest_instance_metrics (BackgroundTasks): reconfigurator config not yet loaded; doing nothing background_task = tuf_repo_pruner
8132026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 29.92\u{b5}s iteration = 1 status = {"reason":"reconfigurator config not yet loaded","status":"disabled"}
8142026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
8152026-03-03T18:55:02.703ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database
8162026-03-03T18:55:02.703ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
8172026-03-03T18:55:02.704ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
8182026-03-03T18:55:02.704ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = alert_dispatcher iteration = 1 reason = Timeout
8192026-03-03T18:55:02.704ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database
8202026-03-03T18:55:02.704ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
8212026-03-03T18:55:02.704ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
8222026-03-03T18:55:02.704ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = webhook_deliverator iteration = 1 reason = Timeout
8232026-03-03T18:55:02.704ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database
8242026-03-03T18:55:02.704ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
8252026-03-03T18:55:02.705ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = webhook_deliverator resource = Database result = Ok(())
8262026-03-03T18:55:02.705ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 1 reason = Timeout
8272026-03-03T18:55:02.705ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
8282026-03-03T18:55:02.705ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
8292026-03-03T18:55:02.705ZDEBGtest_instance_metrics (BackgroundTasks): skipping cache invalidation check: no inventory available background_task = multicast_reconciler
8302026-03-03T18:55:02.705ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8312026-03-03T18:55:02.705ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 1 reason = Timeout
8322026-03-03T18:55:02.705ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
8332026-03-03T18:55:02.705ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = fm_sitrep_loader iteration = 1 reason = Timeout
8342026-03-03T18:55:02.705ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet
8352026-03-03T18:55:02.705ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8362026-03-03T18:55:02.705ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database
8372026-03-03T18:55:02.705ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
8382026-03-03T18:55:02.706ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
8392026-03-03T18:55:02.706ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = fm_sitrep_gc iteration = 1 reason = Timeout
8402026-03-03T18:55:02.706ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
8412026-03-03T18:55:02.706ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
8422026-03-03T18:55:02.706ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
8432026-03-03T18:55:02.706ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = probe_distributor iteration = 1 reason = Timeout
8442026-03-03T18:55:02.706ZINFOtest_instance_metrics (BackgroundTasks): distributing networking probes to sleds background_task = probe_distributor
8452026-03-03T18:55:02.706ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
8462026-03-03T18:55:02.706ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8472026-03-03T18:55:02.706ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
8482026-03-03T18:55:02.706ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
8492026-03-03T18:55:02.707ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
8502026-03-03T18:55:02.707ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = trust_quorum_manager iteration = 1 reason = Timeout
8512026-03-03T18:55:02.707ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet
8522026-03-03T18:55:02.707ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = trust_quorum_manager bgtask = TrustQuorumManager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8532026-03-03T18:55:02.707ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database
8542026-03-03T18:55:02.707ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
8552026-03-03T18:55:02.707ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
8562026-03-03T18:55:02.707ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = attached_subnet_manager iteration = 1 reason = Timeout
8572026-03-03T18:55:02.707ZINFOtest_instance_metrics (BackgroundTasks): starting attached subnet manager work background_task = attached_subnet_manager
8582026-03-03T18:55:02.707ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8592026-03-03T18:55:02.708ZTRACtest_instance_metrics (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: 6f fd 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 o............_na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:55690 req_id = 8bbe05ac-333a-4cc4-9272-1313a09a8fd0
8602026-03-03T18:55:02.708ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 28669,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:55690 req_id = 8bbe05ac-333a-4cc4-9272-1313a09a8fd0
8612026-03-03T18:55:02.708ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 28669, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_nameservice._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 12, 95, 110, 97, 109, 101, 115, 101, 114, 118, 105, 99, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_nameservice._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:55690 req_id = 8bbe05ac-333a-4cc4-9272-1313a09a8fd0
8622026-03-03T18:55:02.708ZTRACtest_instance_metrics (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: 38 38 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 88..........._ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:46380 req_id = 20b34781-e3cb-4b90-a2e5-b614cfe2344e
8632026-03-03T18:55:02.708ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 14392,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:46380 req_id = 20b34781-e3cb-4b90-a2e5-b614cfe2344e
8642026-03-03T18:55:02.708ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 14392, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_external-dns._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 13, 95, 101, 120, 116, 101, 114, 110, 97, 108, 45, 100, 110, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_external-dns._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:46380 req_id = 20b34781-e3cb-4b90-a2e5-b614cfe2344e
8652026-03-03T18:55:02.709ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
8662026-03-03T18:55:02.709ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
8672026-03-03T18:55:02.709ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
8682026-03-03T18:55:02.709ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8692026-03-03T18:55:02.709ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8702026-03-03T18:55:02.713ZWARNtest_instance_metrics (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_external dns_group = external error = proto error: no records found for Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8712026-03-03T18:55:02.713ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 27.337334ms iteration = 1 status = {"error":"failed to read list of DNS servers: proto error: no records found for Query { name: Name(\\"_external-dns._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8722026-03-03T18:55:02.713ZWARNtest_instance_metrics (BackgroundTasks): failed to lookup DNS servers background_task = dns_servers_internal dns_group = internal error = proto error: no records found for Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8732026-03-03T18:55:02.713ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 28.882266ms iteration = 1 status = {"error":"failed to read list of DNS servers: proto error: no records found for Query { name: Name(\\"_nameservice._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
8742026-03-03T18:55:02.713ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: a3 66 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .f..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:43392 req_id = 41b6f393-1480-4a6a-9b5a-a2f950b11eae
8752026-03-03T18:55:02.713ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 41830,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:43392 req_id = 41b6f393-1480-4a6a-9b5a-a2f950b11eae
8762026-03-03T18:55:02.713ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 41830, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:43392 req_id = 41b6f393-1480-4a6a-9b5a-a2f950b11eae
8772026-03-03T18:55:02.713ZTRACtest_instance_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: e8 17 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:59507 req_id = 75936db1-1ce8-4bd2-9136-1626db713d6d
8782026-03-03T18:55:02.714ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 59415,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59507 req_id = 75936db1-1ce8-4bd2-9136-1626db713d6d
8792026-03-03T18:55:02.714ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 59415, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:59507 req_id = 75936db1-1ce8-4bd2-9136-1626db713d6d
8802026-03-03T18:55:02.714ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 07 50 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .P..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:9964 req_id = 7330cef8-3220-4487-849b-5c574b0855b7
8812026-03-03T18:55:02.714ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1872,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:9964 req_id = 7330cef8-3220-4487-849b-5c574b0855b7
8822026-03-03T18:55:02.714ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1872, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:9964 req_id = 7330cef8-3220-4487-849b-5c574b0855b7
8832026-03-03T18:55:02.714ZERROtest_instance_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = multicast_reconciler error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8842026-03-03T18:55:02.714ZERROtest_instance_metrics (BackgroundTasks): failed to build DPD clients background_task = multicast_reconciler error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8852026-03-03T18:55:02.714ZERROtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed with dataplane inconsistencies active_groups_verified = 0 background_task = multicast_reconciler dataplane_error_count = 1 external_groups_created = 0 external_groups_deleted = 0 member_state_transitions = 0 orphaned_members_cleaned = 0
8862026-03-03T18:55:02.714ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 9.523606ms iteration = 1 status = {"disabled":false,"empty_groups_marked":0,"errors":["failed to create multicast dataplane client: Internal Error: failed to build DPD clients"],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
8872026-03-03T18:55:02.714ZERROtest_instance_metrics (BackgroundTasks): failed to resolve MGS addresses background_task = sp_ereport_ingester error = Resolve(ResolveError { kind: Proto(ProtoError { kind: NoRecordsFound { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, soa: None, ns: None, negative_ttl: None, response_code: ServFail, trusted: true, authorities: None } }) })
8882026-03-03T18:55:02.714ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 9.370815ms iteration = 1 status = {"disabled":false,"errors":["failed to resolve MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"],"sps":[]}
8892026-03-03T18:55:02.715ZERROtest_instance_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = attached_subnet_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8902026-03-03T18:55:02.715ZERROtest_instance_metrics (BackgroundTasks): failed to lookup Dendrite clients, will not be able to forward attachments to Dendrite background_task = attached_subnet_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8912026-03-03T18:55:02.715ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database
8922026-03-03T18:55:02.715ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = attached_subnet_manager roles = RoleSet { roles: {} }
8932026-03-03T18:55:02.715ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = attached_subnet_manager resource = Database result = Ok(())
8942026-03-03T18:55:02.716ZINFOtest_instance_metrics (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2026-03-03 18:45:02.685995184 UTC pruned = {}
8952026-03-03T18:55:02.716ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.357058ms iteration = 1 status = {"expiration":"2026-03-03T18:45:02.685995184Z","pruned":[]}
8962026-03-03T18:55:02.717ZTRACtest_instance_metrics (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
8972026-03-03T18:55:02.717ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: cb dc 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:6028 req_id = 7fec76a3-908d-4795-8aa6-1cce00e1d3c4
8982026-03-03T18:55:02.717ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52188,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:6028 req_id = 7fec76a3-908d-4795-8aa6-1cce00e1d3c4
8992026-03-03T18:55:02.717ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 52188, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:6028 req_id = 7fec76a3-908d-4795-8aa6-1cce00e1d3c4
9002026-03-03T18:55:02.717ZERROtest_instance_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9012026-03-03T18:55:02.717ZERROtest_instance_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = bfd_manager error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9022026-03-03T18:55:02.717ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 28.094245ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: proto error: no records found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9032026-03-03T18:55:02.721ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 30.8766ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9042026-03-03T18:55:02.784ZDEBGtest_instance_metrics (init_with_steps): Running step start_dendrite_switch0
9052026-03-03T18:55:02.784ZDEBGtest_instance_metrics: Starting Dendrite for switch0
9062026-03-03T18:55:02.812ZDEBGtest_instance_metrics (init_with_steps): Running step start_mgd_switch0
9072026-03-03T18:55:02.813ZDEBGtest_instance_metrics: Starting mgd for switch0
9082026-03-03T18:55:02.855ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36160
9092026-03-03T18:55:02.859ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36160 req_id = c43eb9e3-bec8-4742-8b08-85b77f0e9550 uri = /nat/ipv4/changeset/0?limit=100
9102026-03-03T18:55:02.859ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36160 req_id = c43eb9e3-bec8-4742-8b08-85b77f0e9550 uri = /nat/ipv4/changeset/0?limit=100 version = 1.0.0
9112026-03-03T18:55:02.859ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36160 req_id = c43eb9e3-bec8-4742-8b08-85b77f0e9550 resource = Database type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9122026-03-03T18:55:02.859ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36160 req_id = c43eb9e3-bec8-4742-8b08-85b77f0e9550 roles = RoleSet { roles: {} } type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9132026-03-03T18:55:02.859ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36160 req_id = c43eb9e3-bec8-4742-8b08-85b77f0e9550 resource = Database result = Ok(()) type = user_builtin uri = /nat/ipv4/changeset/0?limit=100 user_builtin_id = 001de000-05e4-4000-8000-000000000002
9142026-03-03T18:55:02.859ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
9152026-03-03T18:55:02.859ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 07 a4 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:18934 req_id = ed26287b-42ea-4557-bd22-a12f584258b9
9162026-03-03T18:55:02.859ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 1956,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:18934 req_id = ed26287b-42ea-4557-bd22-a12f584258b9
9172026-03-03T18:55:02.859ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 1956, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_dendrite._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 9, 95, 100, 101, 110, 100, 114, 105, 116, 101, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_dendrite._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:18934 req_id = ed26287b-42ea-4557-bd22-a12f584258b9
9182026-03-03T18:55:02.859ZERROtest_instance_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_garbage_collector error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9192026-03-03T18:55:02.859ZERROtest_instance_metrics (BackgroundTasks): failed to resolve addresses for Dendrite services background_task = nat_garbage_collector error = proto error: no records found for Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
9202026-03-03T18:55:02.859ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = nat_garbage_collector elapsed = 170.054913ms iteration = 1 status = {"error":"failed to resolve addresses for Dendrite services: proto error: no records found for Query { name: Name(\\"_dendrite._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
9212026-03-03T18:55:02.874ZDEBGtest_instance_metrics: mgd port is 41439
9222026-03-03T18:55:02.874ZDEBGtest_instance_metrics (init_with_steps): Running step record_switch_dns
9232026-03-03T18:55:02.874ZDEBGtest_instance_metrics: Recording DNS for the switch zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 switch_location = switch0
9242026-03-03T18:55:02.876ZDEBGtest_instance_metrics (init_with_steps): Running step start_sled1
9252026-03-03T18:55:02.876ZINFOtest_instance_metrics (omicron_sled_agent::sim::Server): setting up sled agent server sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9262026-03-03T18:55:02.896ZINFOtest_instance_metrics (SledAgent): created simulated sled agent server = b6d65341-167c-41df-9b5c-41cded99c229 sim_mode = Explicit sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9272026-03-03T18:55:02.903ZINFOtest_instance_metrics (omicron_sled_agent::sim::SimulatedUpstairs): registered sled b6d65341-167c-41df-9b5c-41cded99c229 storage
9282026-03-03T18:55:02.915ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database
9292026-03-03T18:55:02.915ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9302026-03-03T18:55:02.916ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement resource = Database result = Ok(())
9312026-03-03T18:55:02.917ZINFOtest_instance_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpP2GRsR/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9322026-03-03T18:55:02.917ZDEBGtest_instance_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpP2GRsR/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9332026-03-03T18:55:02.917ZINFOtest_instance_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpb9FdIk/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9342026-03-03T18:55:02.917ZDEBGtest_instance_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpb9FdIk/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9352026-03-03T18:55:02.926ZDEBGtest_instance_metrics (dropshot (Repo Depot)): registered endpoint local_addr = [::1]:41667 method = GET path = /artifact/sha256/{sha256} server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9362026-03-03T18:55:02.926ZINFOtest_instance_metrics (dropshot (Repo Depot)): listening local_addr = [::1]:41667 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9372026-03-03T18:55:02.926ZDEBGtest_instance_metrics (dropshot (Repo Depot)): successfully registered DTrace USDT probes local_addr = [::1]:41667 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
9382026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /artifacts sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9392026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /artifacts/{sha256} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9402026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /artifacts/{sha256}/copy-from-depot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9412026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9422026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /artifacts-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9432026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /bootstore/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9442026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /chicken-switch/destroy-orphaned-datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 2.0.0
9452026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /chicken-switch/destroy-orphaned-datasets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 3.0.0
9462026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /debug/switch-zone-policy sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 3.0.0
9472026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /debug/switch-zone-policy sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 3.0.0
9482026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /disks/{disk_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 21.0.0
9492026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /eip-gateways sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9502026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 22.0.0
9512026-03-03T18:55:02.929ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 16.0.0 to 22.0.0
9522026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 14.0.0 to 16.0.0
9532026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 12.0.0 to 14.0.0
9542026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 12.0.0
9552026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
9562026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 4.0.0 to 10.0.0
9572026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /inventory sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 4.0.0
9582026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /local-storage sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 17.0.0
9592026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /local-storage sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 17.0.0
9602026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /local-storage/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 17.0.0
9612026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /local-storage/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 17.0.0
9622026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 20.0.0 to 23.0.0
9632026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
9642026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 20.0.0
9652026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /network-bootstore-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
9662026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 14.0.0
9672026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 14.0.0
9682026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
9692026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 4.0.0 to 10.0.0
9702026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /omicron-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 4.0.0
9712026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /probes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 10.0.0
9722026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /probes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 6.0.0 to 10.0.0
9732026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /rot/{rot}/attest sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
9742026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /rot/{rot}/certificate-chain sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
9752026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /rot/{rot}/measurement-log sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 19.0.0
9762026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /sled-identifiers sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9772026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /sled-role sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 8.0.0
9782026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /sleds sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9792026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/dladm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9802026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/health-check sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9812026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/ipadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9822026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/logs/download/{zone} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9832026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/logs/zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9842026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/nvmeadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9852026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/pargs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9862026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/pfiles-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9872026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/pstack-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9882026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/zfs-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9892026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/zoneadm-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9902026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support/zpool-info sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9912026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support-bundles/{zpool_id}/{dataset_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9922026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9932026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9942026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9952026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9962026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9972026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/download/{file} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9982026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/finalize sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
9992026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10002026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = HEAD path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/index sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10012026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /support-bundles/{zpool_id}/{dataset_id}/{support_bundle_id}/transfer sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10022026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 20.0.0
10032026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /switch-ports sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 20.0.0
10042026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /trust-quorum/commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10052026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /trust-quorum/configuration sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10062026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /trust-quorum/coordinator-status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10072026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /trust-quorum/network-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10082026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /trust-quorum/network-config sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10092026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /trust-quorum/prepare-and-commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10102026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /trust-quorum/proxy/commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10112026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /trust-quorum/proxy/prepare-and-commit sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10122026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /trust-quorum/proxy/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10132026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /trust-quorum/status sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 15.0.0
10142026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /trust-quorum/upgrade sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 13.0.0
10152026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10162026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10172026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /v2p sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10182026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10192026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10202026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 17.0.0 to 18.0.0
10212026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 11.0.0 to 17.0.0
10222026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 10.0.0 to 11.0.0
10232026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 9.0.0 to 10.0.0
10242026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = from 7.0.0 to 9.0.0
10252026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 7.0.0
10262026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10272026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10282026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id}/attached-subnets sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10292026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /vmms/{propolis_id}/attached-subnets/{subnet} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 18.0.0
10302026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /vmms/{propolis_id}/disks/{disk_id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10312026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10322026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id}/external-ip sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10332026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /vmms/{propolis_id}/multicast-group sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 7.0.0
10342026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id}/multicast-group sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 7.0.0
10352026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /vmms/{propolis_id}/poke sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10362026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /vmms/{propolis_id}/poke-single-step sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10372026-03-03T18:55:02.930ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /vmms/{propolis_id}/sim-migration-source sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10382026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10392026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vmms/{propolis_id}/state sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10402026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all starting from 10.0.0
10412026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vpc/{vpc_id}/firewall/rules sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all ending with 10.0.0
10422026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10432026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /vpc-routes sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10442026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /zones sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10452026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = POST path = /zones/bundle-cleanup sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10462026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10472026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = PUT path = /zones/bundle-cleanup/context sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10482026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /zones/bundle-cleanup/utilization sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10492026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /zones/bundles sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10502026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /zones/bundles/{zone_name} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10512026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = DELETE path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10522026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:37139 method = GET path = /zones/bundles/{zone_name}/{bundle_id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
10532026-03-03T18:55:02.931ZINFOtest_instance_metrics (dropshot): listening local_addr = [::1]:37139 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10542026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:37139 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10552026-03-03T18:55:02.931ZDEBGtest_instance_metrics (omicron_sled_agent::sim::Server): contacting server nexus sled_id = b6d65341-167c-41df-9b5c-41cded99c229
10562026-03-03T18:55:02.931ZDEBGtest_instance_metrics (NexusClient): client request body = Some(Body) method = POST sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:33727/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
10572026-03-03T18:55:02.931ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36162
10582026-03-03T18:55:02.931ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36162 req_id = 0769ee0e-d3ac-44e5-af7c-dd5706d88d0a uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
10592026-03-03T18:55:02.931ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36162 req_id = 0769ee0e-d3ac-44e5-af7c-dd5706d88d0a uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229 version = 1.0.0
10602026-03-03T18:55:02.932ZINFOtest_instance_metrics (nexus): registered sled agent sled_uuid = b6d65341-167c-41df-9b5c-41cded99c229
10612026-03-03T18:55:02.976ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622026-03-03T18:55:02.979ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10632026-03-03T18:55:02.979ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
10642026-03-03T18:55:02.979ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10652026-03-03T18:55:02.979ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
10662026-03-03T18:55:02.980ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
10672026-03-03T18:55:02.981ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10682026-03-03T18:55:02.981ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10692026-03-03T18:55:02.987ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10702026-03-03T18:55:02.991ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10712026-03-03T18:55:02.991ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database
10722026-03-03T18:55:02.991ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10732026-03-03T18:55:02.991ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_watcher resource = Database result = Ok(())
10742026-03-03T18:55:02.994ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10752026-03-03T18:55:03.016ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10762026-03-03T18:55:03.017ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
10772026-03-03T18:55:03.017ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10782026-03-03T18:55:03.017ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
10792026-03-03T18:55:03.018ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802026-03-03T18:55:03.021ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10812026-03-03T18:55:03.021ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database
10822026-03-03T18:55:03.021ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10832026-03-03T18:55:03.022ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10842026-03-03T18:55:03.022ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852026-03-03T18:55:03.025ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10862026-03-03T18:55:03.025ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
10872026-03-03T18:55:03.025ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10882026-03-03T18:55:03.025ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10892026-03-03T18:55:03.026ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database
10902026-03-03T18:55:03.026ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10912026-03-03T18:55:03.026ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10922026-03-03T18:55:03.027ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932026-03-03T18:55:03.031ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
10942026-03-03T18:55:03.031ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
10952026-03-03T18:55:03.031ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
10962026-03-03T18:55:03.031ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
10972026-03-03T18:55:03.032ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10982026-03-03T18:55:03.036ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10992026-03-03T18:55:03.039ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002026-03-03T18:55:03.054ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
11012026-03-03T18:55:03.055ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
11022026-03-03T18:55:03.063ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
11032026-03-03T18:55:03.063ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
11042026-03-03T18:55:03.070ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052026-03-03T18:55:03.072ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
11062026-03-03T18:55:03.072ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
11072026-03-03T18:55:03.072ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11082026-03-03T18:55:03.073ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
11092026-03-03T18:55:03.120ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 419.341781ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
11102026-03-03T18:55:03.139ZINFOtest_instance_metrics (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator num_receivers = 0
11112026-03-03T18:55:03.139ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 434.603405ms iteration = 1 status = {"by_rx":{},"error":null}
11122026-03-03T18:55:03.182ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132026-03-03T18:55:03.182ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Fleet result = Ok(())
11142026-03-03T18:55:03.182ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database
11152026-03-03T18:55:03.182ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_loader roles = RoleSet { roles: {} }
11162026-03-03T18:55:03.182ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_loader resource = Database result = Ok(())
11172026-03-03T18:55:03.192ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182026-03-03T18:55:03.192ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
11192026-03-03T18:55:03.192ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
11202026-03-03T18:55:03.192ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11212026-03-03T18:55:03.192ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
11222026-03-03T18:55:03.192ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
11232026-03-03T18:55:03.192ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
11242026-03-03T18:55:03.195ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet
11252026-03-03T18:55:03.195ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_gc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11262026-03-03T18:55:03.195ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
11272026-03-03T18:55:03.195ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
11282026-03-03T18:55:03.195ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
11292026-03-03T18:55:03.206ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302026-03-03T18:55:03.209ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Fleet result = Ok(())
11312026-03-03T18:55:03.209ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database
11322026-03-03T18:55:03.209ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = trust_quorum_manager bgtask = TrustQuorumManager roles = RoleSet { roles: {} }
11332026-03-03T18:55:03.210ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = trust_quorum_manager bgtask = TrustQuorumManager resource = Database result = Ok(())
11342026-03-03T18:55:03.259ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352026-03-03T18:55:03.264ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11362026-03-03T18:55:03.277ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372026-03-03T18:55:03.291ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11382026-03-03T18:55:03.291ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
11392026-03-03T18:55:03.291ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11402026-03-03T18:55:03.291ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
11412026-03-03T18:55:03.291ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11422026-03-03T18:55:03.293ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11432026-03-03T18:55:03.293ZDEBGtest_instance_metrics (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11442026-03-03T18:55:03.293ZINFOtest_instance_metrics (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11452026-03-03T18:55:03.293ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 592.778709ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11462026-03-03T18:55:03.293ZWARNtest_instance_metrics (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0
11472026-03-03T18:55:03.293ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 610.834148ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
11482026-03-03T18:55:03.295ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 591.256197ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
11492026-03-03T18:55:03.331ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 475466 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36160 req_id = c43eb9e3-bec8-4742-8b08-85b77f0e9550 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11502026-03-03T18:55:03.333ZINFOtest_instance_metrics (SagaRecoverer): listed in-progress sagas count = 0
11512026-03-03T18:55:03.333ZINFOtest_instance_metrics (SagaQuiesceHandle): saga recovery pass finished blueprint_id = None generation = 1
11522026-03-03T18:55:03.333ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 631.969601ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
11532026-03-03T18:55:03.368ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig
11542026-03-03T18:55:03.369ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11552026-03-03T18:55:03.370ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
11562026-03-03T18:55:03.370ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11572026-03-03T18:55:03.370ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
11582026-03-03T18:55:03.370ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
11592026-03-03T18:55:03.370ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11602026-03-03T18:55:03.370ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11612026-03-03T18:55:03.370ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 666.457937ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
11622026-03-03T18:55:03.386ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
11632026-03-03T18:55:03.386ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11642026-03-03T18:55:03.386ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11652026-03-03T18:55:03.398ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.701925ms iteration = 1 status = {}
11662026-03-03T18:55:03.406ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database
11672026-03-03T18:55:03.406ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11682026-03-03T18:55:03.406ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11692026-03-03T18:55:03.406ZWARNtest_instance_metrics (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set
11702026-03-03T18:55:03.406ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 712.527121ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11712026-03-03T18:55:03.413ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722026-03-03T18:55:03.413ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
11732026-03-03T18:55:03.413ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
11742026-03-03T18:55:03.413ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11752026-03-03T18:55:03.413ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
11762026-03-03T18:55:03.413ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
11772026-03-03T18:55:03.413ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
11782026-03-03T18:55:03.439ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
11792026-03-03T18:55:03.440ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11802026-03-03T18:55:03.440ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
11812026-03-03T18:55:03.446ZDEBGtest_instance_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T18:55:02.625804Z })
11822026-03-03T18:55:03.446ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 755.105229ms iteration = 1 status = {"config_updated":true}
11832026-03-03T18:55:03.446ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 2 reason = Dependency
11842026-03-03T18:55:03.446ZDEBGtest_instance_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
11852026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 52.72\u{b5}s iteration = 2 status = "Disabled"
11862026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = tuf_repo_pruner iteration = 2 reason = Dependency
11872026-03-03T18:55:03.448ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet
11882026-03-03T18:55:03.448ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
11892026-03-03T18:55:03.448ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
11902026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
11912026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
11922026-03-03T18:55:03.448ZTRACtest_instance_metrics (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = instance failed total_found = 0
11932026-03-03T18:55:03.448ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database
11942026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11952026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11962026-03-03T18:55:03.448ZDEBGtest_instance_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
11972026-03-03T18:55:03.448ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
11982026-03-03T18:55:03.449ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 758.103744ms iteration = 1 status = "NoCollections"
11992026-03-03T18:55:03.449ZWARNtest_instance_metrics (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0
12002026-03-03T18:55:03.449ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 764.477054ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
12012026-03-03T18:55:03.449ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 746.775255ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
12022026-03-03T18:55:03.449ZTRACtest_instance_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: af b0 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:57288 req_id = 68f314a5-3926-496c-b45c-d86640754c5c
12032026-03-03T18:55:03.449ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 44976,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:57288 req_id = 68f314a5-3926-496c-b45c-d86640754c5c
12042026-03-03T18:55:03.450ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 44976, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_mgs._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 4, 95, 109, 103, 115, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } SERVFAIL: server is not authoritative for name: "_mgs._tcp.control-plane.oxide.internal." kind = dns peer_addr = [::1]:57288 req_id = 68f314a5-3926-496c-b45c-d86640754c5c
12052026-03-03T18:55:03.450ZWARNtest_instance_metrics (BackgroundTasks): inventory collection failed background_task = inventory_collection error = failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
12062026-03-03T18:55:03.450ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 759.852487ms iteration = 1 status = {"error":"failed to collect inventory: looking up MGS addresses: proto error: no records found for Query { name: Name(\\"_mgs._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }"}
12072026-03-03T18:55:03.471ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12082026-03-03T18:55:03.474ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
12092026-03-03T18:55:03.474ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
12102026-03-03T18:55:03.474ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
12112026-03-03T18:55:03.474ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
12122026-03-03T18:55:03.475ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132026-03-03T18:55:03.476ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
12142026-03-03T18:55:03.494ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
12152026-03-03T18:55:03.494ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
12162026-03-03T18:55:03.494ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12172026-03-03T18:55:03.494ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12182026-03-03T18:55:03.494ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12192026-03-03T18:55:03.510ZTRACtest_instance_metrics (BackgroundTasks): reprocessing 0 outdated webhook globs... background_task = alert_dispatcher
12202026-03-03T18:55:03.510ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database
12212026-03-03T18:55:03.510ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12222026-03-03T18:55:03.510ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12232026-03-03T18:55:03.511ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = fm_sitrep_loader elapsed = 805.432319ms iteration = 1 status = "NoSitrep"
12242026-03-03T18:55:03.518ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 816.789927ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12252026-03-03T18:55:03.519ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
12262026-03-03T18:55:03.519ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
12272026-03-03T18:55:03.521ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
12282026-03-03T18:55:03.521ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292026-03-03T18:55:03.524ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12302026-03-03T18:55:03.524ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
12312026-03-03T18:55:03.524ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12322026-03-03T18:55:03.525ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
12332026-03-03T18:55:03.525ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12342026-03-03T18:55:03.528ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
12352026-03-03T18:55:03.528ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
12362026-03-03T18:55:03.528ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
12372026-03-03T18:55:03.529ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
12382026-03-03T18:55:03.529ZINFOtest_instance_metrics (BackgroundTasks): all instance checks complete background_task = instance_watcher pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12392026-03-03T18:55:03.529ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 832.342422ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12402026-03-03T18:55:03.529ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412026-03-03T18:55:03.533ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
12422026-03-03T18:55:03.533ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12432026-03-03T18:55:03.533ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12442026-03-03T18:55:03.533ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12452026-03-03T18:55:03.533ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = region_replacement elapsed = 836.80823ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12462026-03-03T18:55:03.573ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet
12472026-03-03T18:55:03.573ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = fm_sitrep_gc resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12482026-03-03T18:55:03.573ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database
12492026-03-03T18:55:03.573ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {} }
12502026-03-03T18:55:03.573ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Database result = Ok(())
12512026-03-03T18:55:03.596ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
12522026-03-03T18:55:03.597ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12532026-03-03T18:55:03.597ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12542026-03-03T18:55:03.601ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12552026-03-03T18:55:03.624ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet
12562026-03-03T18:55:03.624ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12572026-03-03T18:55:03.624ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12582026-03-03T18:55:03.624ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12592026-03-03T18:55:03.625ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12602026-03-03T18:55:03.711ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 1.014599004s iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12612026-03-03T18:55:03.724ZTRACtest_instance_metrics (BackgroundTasks): webhook dispatching completed successfully background_task = alert_dispatcher events_dispatched = 0 events_without_receivers = 0
12622026-03-03T18:55:03.724ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 1.019470932s iteration = 1 status = {"dispatched":[],"errors":[],"glob_version":"233.0.0","globs_reprocessed":{},"no_receivers":[]}
12632026-03-03T18:55:03.728ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = fm_sitrep_gc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12642026-03-03T18:55:03.728ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = fm_sitrep_gc resource = Fleet result = Ok(())
12652026-03-03T18:55:03.738ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12662026-03-03T18:55:03.738ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
12672026-03-03T18:55:03.738ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12682026-03-03T18:55:03.738ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12692026-03-03T18:55:03.761ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702026-03-03T18:55:03.763ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12712026-03-03T18:55:03.763ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
12722026-03-03T18:55:03.763ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12732026-03-03T18:55:03.763ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12742026-03-03T18:55:03.764ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752026-03-03T18:55:03.767ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Fleet result = Ok(())
12762026-03-03T18:55:03.767ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
12772026-03-03T18:55:03.767ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
12782026-03-03T18:55:03.768ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
12792026-03-03T18:55:03.768ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet
12802026-03-03T18:55:03.768ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = support_bundle_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12812026-03-03T18:55:03.772ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
12822026-03-03T18:55:03.772ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12832026-03-03T18:55:03.772ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12842026-03-03T18:55:03.773ZINFOtest_instance_metrics (BackgroundTasks): Loaded 0 active trust quorum configurations from database background_task = trust_quorum_manager bgtask = TrustQuorumManager
12852026-03-03T18:55:03.773ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = trust_quorum_manager elapsed = 1.066216937s iteration = 1 status = {"PerRackStatus":{"errors":[],"statuses":[]}}
12862026-03-03T18:55:03.774ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database
12872026-03-03T18:55:03.777ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12882026-03-03T18:55:03.778ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12892026-03-03T18:55:03.789ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
12902026-03-03T18:55:03.789ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
12912026-03-03T18:55:03.789ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
12922026-03-03T18:55:03.789ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
12932026-03-03T18:55:03.789ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12942026-03-03T18:55:03.797ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
12952026-03-03T18:55:03.797ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 860009 local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36162 req_id = 0769ee0e-d3ac-44e5-af7c-dd5706d88d0a response_code = 204 uri = /sled-agents/b6d65341-167c-41df-9b5c-41cded99c229
12962026-03-03T18:55:03.797ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972026-03-03T18:55:03.802ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12982026-03-03T18:55:03.802ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database
12992026-03-03T18:55:03.802ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13002026-03-03T18:55:03.802ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13012026-03-03T18:55:03.802ZDEBGtest_instance_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:33727/sled-agents/b6d65341-167c-41df-9b5c-41cded99c229", status: 204, headers: {"x-request-id": "0769ee0e-d3ac-44e5-af7c-dd5706d88d0a", "date": "Tue, 03 Mar 2026 18:55:03 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13022026-03-03T18:55:03.802ZDEBGtest_instance_metrics (init_with_steps): Running step configure_boundary_ntp
13032026-03-03T18:55:03.802ZDEBGtest_instance_metrics (init_with_steps): Running step start_crucible_pantry
13042026-03-03T18:55:03.802ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = GET path = /crucible/pantry/0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13052026-03-03T18:55:03.802ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = GET path = /crucible/pantry/0/job/{id}/is-finished sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13062026-03-03T18:55:03.802ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = GET path = /crucible/pantry/0/job/{id}/ok sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13072026-03-03T18:55:03.802ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = DELETE path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13082026-03-03T18:55:03.802ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = GET path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13092026-03-03T18:55:03.802ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = POST path = /crucible/pantry/0/volume/{id} sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13102026-03-03T18:55:03.803ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = POST path = /crucible/pantry/0/volume/{id}/background sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13112026-03-03T18:55:03.803ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = POST path = /crucible/pantry/0/volume/{id}/bulk-write sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13122026-03-03T18:55:03.803ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = POST path = /crucible/pantry/0/volume/{id}/import-from-url sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13132026-03-03T18:55:03.803ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = POST path = /crucible/pantry/0/volume/{id}/scrub sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13142026-03-03T18:55:03.803ZDEBGtest_instance_metrics (dropshot): registered endpoint kind = pantry local_addr = [::1]:37499 method = POST path = /crucible/pantry/0/volume/{id}/snapshot sled_id = b6d65341-167c-41df-9b5c-41cded99c229 versions = all
13152026-03-03T18:55:03.803ZINFOtest_instance_metrics (dropshot): listening kind = pantry local_addr = [::1]:37499 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13162026-03-03T18:55:03.803ZDEBGtest_instance_metrics (dropshot): successfully registered DTrace USDT probes kind = pantry local_addr = [::1]:37499 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13172026-03-03T18:55:03.803ZINFOtest_instance_metrics (omicron_sled_agent::sim::Server): Started Simulated Crucible Pantry address = [::1]:37499 kind = pantry sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13182026-03-03T18:55:03.803ZDEBGtest_instance_metrics (init_with_steps): Running step populate_internal_dns
13192026-03-03T18:55:03.803ZDEBGtest_instance_metrics: Populating Internal DNS
13202026-03-03T18:55:03.821ZINFOtest_instance_metrics: DNS population: DnsConfigParams { generation: Generation( 1, ), serial: 1, time_created: 2026-03-03T18:55:03.821481781Z, zones: [ DnsConfigZone { zone_name: "control-plane.oxide.internal", records: { "509a941e-e250-4e50-988f-821caab8ab38.host": [ Aaaa( ::1, ), ], "_nexus-lockstep._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 43143, target: "913233fe-92a8-4635-9572-183f495429c4.host.control-plane.oxide.internal", }, ), ], "ea089734-1711-4991-8e09-9016d0edd1ed.host": [ Aaaa( ::1, ), ], "0a42343f-9002-4d6f-a404-abbda9d40103.host": [ Aaaa( ::1, ), ], "_clickhouse-native._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "c7ffb7d3-1bd1-4804-bdb9-036dd0f69cce.host.control-plane.oxide.internal", }, ), ], "@": [ Ns( "ns1.control-plane.oxide.internal", ), ], "b6d65341-167c-41df-9b5c-41cded99c229.sled": [ Aaaa( ::1, ), ], "8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host": [ Aaaa( ::1, ), ], "_repo-depot._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 41667, target: "b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal", }, ), ], "_oximeter-reader._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 9000, target: "c7ffb7d3-1bd1-4804-bdb9-036dd0f69cce.host.control-plane.oxide.internal", }, ), ], "_cockroach._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 41875, target: "0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal", }, ), ], "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host": [ Aaaa( ::1, ), ], "boundary-ntp": [ Aaaa( ::1, ), ], "_clickhouse._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 37911, target: "c7ffb7d3-1bd1-4804-bdb9-036dd0f69cce.host.control-plane.oxide.internal", }, ), ], "_clickhouse-admin-single-server._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 8888, target: "c7ffb7d3-1bd1-4804-bdb9-036dd0f69cce.host.control-plane.oxide.internal", }, ), ], "_external-dns._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 41835, target: "ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal", }, ), ], "_mgs._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 35581, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "_dendrite._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 39131, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], "_boundary-ntp._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 123, target: "509a941e-e250-4e50-988f-821caab8ab38.host.control-plane.oxide.internal", }, ), ], "_nexus._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 33727, target: "913233fe-92a8-4635-9572-183f495429c4.host.control-plane.oxide.internal", }, ), ], "_crucible-pantry._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 37499, target: "fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal", }, ), ], "c7ffb7d3-1bd1-4804-bdb9-036dd0f69cce.host": [ Aaaa( ::1, ), ], "fc4a94aa-404a-4070-a9aa-bb9c3603902d.host": [ Aaaa( ::1, ), ], "913233fe-92a8-4635-9572-183f495429c4.host": [ Aaaa( ::ffff:127.0.0.1, ), ], "ns1": [ Aaaa( ::1, ), ], "_nameservice._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 43761, target: "8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal", }, ), ], "_mgd._tcp": [ Srv( Srv { prio: 0, weight: 0, port: 41439, target: "dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal", }, ), ], }, }, ], }
13212026-03-03T18:55:03.821ZDEBGtest_instance_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:43761/config
13222026-03-03T18:55:03.822ZINFOtest_instance_metrics (BackgroundTasks): No bundles to collect background_task = support_bundle_collector
13232026-03-03T18:55:03.822ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 1.127809985s iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
13242026-03-03T18:55:03.822ZWARNtest_instance_metrics (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone
13252026-03-03T18:55:03.822ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 1.134920507s iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
13262026-03-03T18:55:03.822ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig
13272026-03-03T18:55:03.822ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_repo_pruner resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13282026-03-03T18:55:03.822ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
13292026-03-03T18:55:03.823ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
13302026-03-03T18:55:03.823ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
13312026-03-03T18:55:03.824ZINFOtest_instance_metrics (http): accepted connection kind = dns local_addr = [::1]:43761 remote_addr = [::1]:34068
13322026-03-03T18:55:03.825ZTRACtest_instance_metrics (http): incoming request kind = dns local_addr = [::1]:43761 method = PUT remote_addr = [::1]:34068 req_id = b53780e0-335d-4cbe-a5d0-4e865e70fcbc uri = /config
13332026-03-03T18:55:03.825ZDEBGtest_instance_metrics (http): determined request API version kind = dns local_addr = [::1]:43761 method = PUT remote_addr = [::1]:34068 req_id = b53780e0-335d-4cbe-a5d0-4e865e70fcbc uri = /config version = 2.0.0
13342026-03-03T18:55:03.826ZINFOtest_instance_metrics (store): attempting generation update new_generation = 1 req_id = b53780e0-335d-4cbe-a5d0-4e865e70fcbc
13352026-03-03T18:55:03.826ZINFOtest_instance_metrics (store): pruning trees for generations newer than 0
13362026-03-03T18:55:03.826ZDEBGtest_instance_metrics (store): creating tree tree_name = generation_1_zone_control-plane.oxide.internal
13372026-03-03T18:55:03.827ZDEBGtest_instance_metrics (store): updating current config
13382026-03-03T18:55:03.827ZDEBGtest_instance_metrics (store): flushing default tree
13392026-03-03T18:55:03.829ZINFOtest_instance_metrics (store): pruning trees for generations older than 1 keep = 3
13402026-03-03T18:55:03.829ZINFOtest_instance_metrics (store): updated generation new_generation = 1 req_id = b53780e0-335d-4cbe-a5d0-4e865e70fcbc
13412026-03-03T18:55:03.829ZINFOtest_instance_metrics (http): request completed kind = dns latency_us = 4267 local_addr = [::1]:43761 method = PUT remote_addr = [::1]:34068 req_id = b53780e0-335d-4cbe-a5d0-4e865e70fcbc response_code = 204 uri = /config
13422026-03-03T18:55:03.830ZDEBGtest_instance_metrics: client response result = Ok(Response { url: "http://[::1]:43761/config", status: 204, headers: {"x-request-id": "b53780e0-335d-4cbe-a5d0-4e865e70fcbc", "date": "Tue, 03 Mar 2026 18:55:03 GMT"} })
13432026-03-03T18:55:03.830ZDEBGtest_instance_metrics (init_with_steps): Running step configure_sled_agents
13442026-03-03T18:55:03.839ZDEBGtest_instance_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:37139/omicron-config
13452026-03-03T18:55:03.840ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44644 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
13462026-03-03T18:55:03.840ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13472026-03-03T18:55:03.843ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13482026-03-03T18:55:03.843ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
13492026-03-03T18:55:03.843ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13502026-03-03T18:55:03.843ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
13512026-03-03T18:55:03.844ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44644 req_id = 7375ea82-aeec-4458-8ca6-9a89b9183658 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
13522026-03-03T18:55:03.844ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44644 req_id = 7375ea82-aeec-4458-8ca6-9a89b9183658 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config version = 23.0.0
13532026-03-03T18:55:03.846ZINFOtest_instance_metrics (dropshot): request completed latency_us = 1616 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44644 req_id = 7375ea82-aeec-4458-8ca6-9a89b9183658 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /omicron-config
13542026-03-03T18:55:03.846ZDEBGtest_instance_metrics: client response result = Ok(Response { url: "http://[::1]:37139/omicron-config", status: 204, headers: {"x-request-id": "7375ea82-aeec-4458-8ca6-9a89b9183658", "date": "Tue, 03 Mar 2026 18:55:03 GMT"} })
13552026-03-03T18:55:03.846ZDEBGtest_instance_metrics: client request body = Some(Body) method = PUT uri = http://[::1]:37139/network-bootstore-config
13562026-03-03T18:55:03.847ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44644 req_id = 8eb480f9-b7a5-4858-ade4-563ca5ac04fb sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
13572026-03-03T18:55:03.847ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44644 req_id = 8eb480f9-b7a5-4858-ade4-563ca5ac04fb sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config version = 23.0.0
13582026-03-03T18:55:03.847ZINFOtest_instance_metrics (dropshot): request completed latency_us = 243 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44644 req_id = 8eb480f9-b7a5-4858-ade4-563ca5ac04fb response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /network-bootstore-config
13592026-03-03T18:55:03.847ZDEBGtest_instance_metrics: client response result = Ok(Response { url: "http://[::1]:37139/network-bootstore-config", status: 204, headers: {"x-request-id": "8eb480f9-b7a5-4858-ade4-563ca5ac04fb", "date": "Tue, 03 Mar 2026 18:55:03 GMT"} })
13602026-03-03T18:55:03.848ZDEBGtest_instance_metrics (init_with_steps): Running step start_nexus_external
13612026-03-03T18:55:03.848ZDEBGtest_instance_metrics: Starting Nexus (external API)
13622026-03-03T18:55:03.866ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13632026-03-03T18:55:03.870ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = TargetReleaseConfig result = Ok(())
13642026-03-03T18:55:03.870ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database
13652026-03-03T18:55:03.870ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_repo_pruner roles = RoleSet { roles: {} }
13662026-03-03T18:55:03.871ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_repo_pruner resource = Database result = Ok(())
13672026-03-03T18:55:03.882ZDEBGtest_instance_metrics (BackgroundTasks): listed attached subnets background_task = attached_subnet_manager n_subnets = 0
13682026-03-03T18:55:03.882ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = attached_subnet_manager elapsed = 1.17453302s iteration = 1 status = {"db_error":null,"dendrite":{},"sled":{}}
13692026-03-03T18:55:03.929ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
13702026-03-03T18:55:03.929ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
13712026-03-03T18:55:03.929ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
13722026-03-03T18:55:03.929ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13732026-03-03T18:55:03.930ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13742026-03-03T18:55:03.931ZDEBGtest_instance_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
13752026-03-03T18:55:03.931ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
13762026-03-03T18:55:03.932ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772026-03-03T18:55:03.937ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13782026-03-03T18:55:03.937ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
13792026-03-03T18:55:03.937ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
13802026-03-03T18:55:03.937ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
13812026-03-03T18:55:03.937ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13822026-03-03T18:55:03.937ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13832026-03-03T18:55:03.939ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13842026-03-03T18:55:03.952ZINFOtest_instance_metrics (BackgroundTasks): tuf_repo_prune decision background_task = tuf_repo_pruner status = TufRepoPrunerDetails { nkeep_recent_releases: 3, nkeep_recent_uploads: 2, repos_keep_target_release: {}, repos_keep_recent_uploads: {}, repo_prune: None, other_repos_eligible_to_prune: {}, warnings: [] }
13852026-03-03T18:55:03.954ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = tuf_repo_pruner elapsed = 506.02568ms iteration = 2 status = {"nkeep_recent_releases":3,"nkeep_recent_uploads":2,"other_repos_eligible_to_prune":[],"repo_prune":null,"repos_keep_recent_uploads":[],"repos_keep_target_release":[],"status":"enabled","warnings":[]}
13862026-03-03T18:55:03.954ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
13872026-03-03T18:55:03.954ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
13882026-03-03T18:55:03.954ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13892026-03-03T18:55:03.954ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13902026-03-03T18:55:03.955ZINFOtest_instance_metrics (BackgroundTasks): deleted 0 of 0 sitreps sitreps background_task = fm_sitrep_gc case_ereports_deleted = 0 cases_deleted = 0 ids = [] sitreps_deleted = 0
13912026-03-03T18:55:03.955ZTRACtest_instance_metrics (BackgroundTasks): all 0 orphaned sitreps in this batch have already been deleted background_task = fm_sitrep_gc
13922026-03-03T18:55:03.955ZINFOtest_instance_metrics (BackgroundTasks): sitrep garbage collection found 0 orphaned sitreps, deleted 0 background_task = fm_sitrep_gc
13932026-03-03T18:55:03.955ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = fm_sitrep_gc elapsed = 1.249291739s iteration = 1 status = {"errors":[],"orphaned_sitreps_deleted":0,"orphaned_sitreps_found":0}
13942026-03-03T18:55:03.955ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13952026-03-03T18:55:03.963ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
13962026-03-03T18:55:03.963ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
13972026-03-03T18:55:03.963ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13982026-03-03T18:55:03.963ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13992026-03-03T18:55:03.964ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14002026-03-03T18:55:03.964ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14012026-03-03T18:55:03.964ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14022026-03-03T18:55:03.965ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14032026-03-03T18:55:03.971ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
14042026-03-03T18:55:03.971ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14052026-03-03T18:55:03.971ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
14062026-03-03T18:55:03.971ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
14072026-03-03T18:55:03.972ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
14082026-03-03T18:55:03.973ZTRACtest_instance_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: 37 19 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 7............_mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:62004 req_id = 4c7136b6-2b4e-4f34-8342-5e5e6a628aa5
14092026-03-03T18:55:03.973ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 14105,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:62004 req_id = 4c7136b6-2b4e-4f34-8342-5e5e6a628aa5
14102026-03-03T18:55:03.973ZDEBGtest_instance_metrics (store): query key key = _mgs._tcp
14112026-03-03T18:55:03.973ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
14122026-03-03T18:55:03.973ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:62004 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 35581, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 4c7136b6-2b4e-4f34-8342-5e5e6a628aa5
14132026-03-03T18:55:03.973ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 35581, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 238468423 } })
14142026-03-03T18:55:03.973ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
14152026-03-03T18:55:03.974ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ed d4 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:12155 req_id = 888c8d42-ac8a-4777-88fd-80c78f7ca9d3
14162026-03-03T18:55:03.974ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 60884,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:12155 req_id = 888c8d42-ac8a-4777-88fd-80c78f7ca9d3
14172026-03-03T18:55:03.980ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
14182026-03-03T18:55:03.980ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:12155 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 888c8d42-ac8a-4777-88fd-80c78f7ca9d3
14192026-03-03T18:55:03.989ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
14202026-03-03T18:55:03.990ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212026-03-03T18:55:03.995ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14222026-03-03T18:55:03.996ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14232026-03-03T18:55:03.996ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14242026-03-03T18:55:03.996ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14252026-03-03T18:55:03.999ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
14262026-03-03T18:55:03.999ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14272026-03-03T18:55:04.000ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14282026-03-03T18:55:04.000ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14292026-03-03T18:55:04.001ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14302026-03-03T18:55:04.002ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 1.29957723s iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14312026-03-03T18:55:04.002ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14322026-03-03T18:55:04.002ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14332026-03-03T18:55:04.002ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14342026-03-03T18:55:04.003ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
14352026-03-03T18:55:04.003ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14362026-03-03T18:55:04.003ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
14372026-03-03T18:55:04.003ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14382026-03-03T18:55:04.003ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
14392026-03-03T18:55:04.004ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet
14402026-03-03T18:55:04.005ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = probe_distributor resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14412026-03-03T18:55:04.005ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
14422026-03-03T18:55:04.005ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
14432026-03-03T18:55:04.007ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
14442026-03-03T18:55:04.007ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452026-03-03T18:55:04.007ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
14462026-03-03T18:55:04.008ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
14472026-03-03T18:55:04.008ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
14482026-03-03T18:55:04.008ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
14492026-03-03T18:55:04.009ZTRACtest_instance_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: 91 ee 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:8186 req_id = 54a719cc-2129-4620-8877-6fb9a4355073
14502026-03-03T18:55:04.009ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 37358,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:8186 req_id = 54a719cc-2129-4620-8877-6fb9a4355073
14512026-03-03T18:55:04.009ZDEBGtest_instance_metrics (store): query key key = _clickhouse-admin-keeper._tcp
14522026-03-03T18:55:04.010ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 37358, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:8186 req_id = 54a719cc-2129-4620-8877-6fb9a4355073
14532026-03-03T18:55:04.010ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
14542026-03-03T18:55:04.010ZTRACtest_instance_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: f3 ec 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f ............._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:47748 req_id = 8af16acf-80f5-4548-b52c-15d045c3e9a2
14552026-03-03T18:55:04.010ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62444,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:47748 req_id = 8af16acf-80f5-4548-b52c-15d045c3e9a2
14562026-03-03T18:55:04.011ZDEBGtest_instance_metrics (store): query key key = _cockroach._tcp
14572026-03-03T18:55:04.011ZDEBGtest_instance_metrics (store): query key key = 0a42343f-9002-4d6f-a404-abbda9d40103.host
14582026-03-03T18:55:04.011ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:47748 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41875, target: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal") }) }] req_id = 8af16acf-80f5-4548-b52c-15d045c3e9a2
14592026-03-03T18:55:04.012ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602026-03-03T18:55:04.015ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
14612026-03-03T18:55:04.015ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14622026-03-03T18:55:04.015ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14632026-03-03T18:55:04.015ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14642026-03-03T18:55:04.015ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652026-03-03T18:55:04.018ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Fleet result = Ok(())
14662026-03-03T18:55:04.018ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database
14672026-03-03T18:55:04.018ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = probe_distributor roles = RoleSet { roles: {} }
14682026-03-03T18:55:04.018ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = probe_distributor resource = Database result = Ok(())
14692026-03-03T18:55:04.019ZTRACtest_instance_metrics (BackgroundTasks): no more instances in need of reincarnation background_task = instance_reincarnation reincarnation_reason = start saga failed total_found = 0
14702026-03-03T18:55:04.019ZINFOtest_instance_metrics (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
14712026-03-03T18:55:04.021ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 1.320907804s iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14722026-03-03T18:55:04.021ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732026-03-03T18:55:04.022ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14742026-03-03T18:55:04.022ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
14752026-03-03T18:55:04.022ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14762026-03-03T18:55:04.022ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
14772026-03-03T18:55:04.022ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14782026-03-03T18:55:04.022ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
14792026-03-03T18:55:04.024ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14802026-03-03T18:55:04.026ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14812026-03-03T18:55:04.026ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
14822026-03-03T18:55:04.026ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14832026-03-03T18:55:04.027ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
14842026-03-03T18:55:04.027ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14852026-03-03T18:55:04.027ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14862026-03-03T18:55:04.028ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14872026-03-03T18:55:04.051ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41875, target: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 315154515 } })
14882026-03-03T18:55:04.051ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
14892026-03-03T18:55:04.051ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet
14902026-03-03T18:55:04.051ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = tuf_artifact_replication resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
14912026-03-03T18:55:04.051ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
14922026-03-03T18:55:04.051ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
14932026-03-03T18:55:04.052ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
14942026-03-03T18:55:04.052ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
14952026-03-03T18:55:04.052ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14962026-03-03T18:55:04.052ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14972026-03-03T18:55:04.065ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = probe_distributor body = Some(Body) method = PUT uri = http://[::1]:37139/probes
14982026-03-03T18:55:04.072ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
14992026-03-03T18:55:04.072ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:37139/vpc-routes
15002026-03-03T18:55:04.072ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15012026-03-03T18:55:04.072ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15022026-03-03T18:55:04.073ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15032026-03-03T18:55:04.073ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44646 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15042026-03-03T18:55:04.073ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44648 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15052026-03-03T18:55:04.074ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
15062026-03-03T18:55:04.074ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
15072026-03-03T18:55:04.074ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15082026-03-03T18:55:04.074ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15092026-03-03T18:55:04.074ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15102026-03-03T18:55:04.075ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112026-03-03T18:55:04.078ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
15122026-03-03T18:55:04.078ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database
15132026-03-03T18:55:04.078ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
15142026-03-03T18:55:04.078ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
15152026-03-03T18:55:04.079ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44646 req_id = 5d328285-f42a-4055-951e-0f8e2d765d2d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /probes
15162026-03-03T18:55:04.079ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44646 req_id = 5d328285-f42a-4055-951e-0f8e2d765d2d sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /probes version = 23.0.0
15172026-03-03T18:55:04.079ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44648 req_id = 7f479acc-67c8-450e-b772-08eb3e522463 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
15182026-03-03T18:55:04.079ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44648 req_id = 7f479acc-67c8-450e-b772-08eb3e522463 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
15192026-03-03T18:55:04.079ZTRACtest_instance_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 65 5e 01 00 00 01 00 00 00 00 00 01 24 30 61 34 e^..........$0a4\n0010: 32 33 34 33 66 2d 39 30 30 32 2d 34 64 36 66 2d 2343f-9002-4d6f-\n0020: 61 34 30 34 2d 61 62 62 64 61 39 64 34 30 31 30 a404-abbda9d4010\n0030: 33 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 3.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:33062 req_id = 81d529c4-2b60-43a0-910c-8ad183c1b8cd
15202026-03-03T18:55:04.079ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25950,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 48,\n 97,\n 52,\n 50,\n 51,\n 52,\n 51,\n 102,\n 45,\n 57,\n 48,\n 48,\n 50,\n 45,\n 52,\n 100,\n 54,\n 102,\n 45,\n 97,\n 52,\n 48,\n 52,\n 45,\n 97,\n 98,\n 98,\n 100,\n 97,\n 57,\n 100,\n 52,\n 48,\n 49,\n 48,\n 51,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:33062 req_id = 81d529c4-2b60-43a0-910c-8ad183c1b8cd
15212026-03-03T18:55:04.079ZDEBGtest_instance_metrics (store): query key key = 0a42343f-9002-4d6f-a404-abbda9d40103.host
15222026-03-03T18:55:04.080ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:33062 query = LowerQuery { name: LowerName(Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal.")), original: Query { name: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 81d529c4-2b60-43a0-910c-8ad183c1b8cd
15232026-03-03T18:55:04.080ZINFOtest_instance_metrics (dropshot): request completed latency_us = 949 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44646 req_id = 5d328285-f42a-4055-951e-0f8e2d765d2d response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /probes
15242026-03-03T18:55:04.080ZINFOtest_instance_metrics (dropshot): request completed latency_us = 877 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44648 req_id = 7f479acc-67c8-450e-b772-08eb3e522463 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
15252026-03-03T18:55:04.093ZDEBGtest_instance_metrics (CockroachClusterAdminClient): Updated CockroachDB cluster backends added = 1 addresses = [[::1]:32222] removed = 0 total = 1
15262026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): begin collection background_task = inventory_collection
15272026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:35581
15282026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/ignition
15292026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[::1]:37139/artifacts-config
15302026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = probe_distributor result = Ok(Response { url: "http://[::1]:37139/probes", status: 204, headers: {"x-request-id": "5d328285-f42a-4055-951e-0f8e2d765d2d", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15312026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): Update set of probes on sled background_task = probe_distributor n_probes = 0 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15322026-03-03T18:55:04.093ZINFOtest_instance_metrics (BackgroundTasks): finished distributing probes to sleds background_task = probe_distributor n_pushed_probes = 0
15332026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = probe_distributor elapsed = 1.383721385s iteration = 1 status = {"errors":[],"probes_by_sled":{"b6d65341-167c-41df-9b5c-41cded99c229":0}}
15342026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f479acc-67c8-450e-b772-08eb3e522463", "content-length": "2", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15352026-03-03T18:55:04.093ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
15362026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15372026-03-03T18:55:04.093ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15382026-03-03T18:55:04.113ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
15392026-03-03T18:55:04.113ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15402026-03-03T18:55:04.113ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15412026-03-03T18:55:04.113ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15422026-03-03T18:55:04.118ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:37139/v2p
15432026-03-03T18:55:04.119ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15442026-03-03T18:55:04.119ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15452026-03-03T18:55:04.119ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15462026-03-03T18:55:04.119ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15472026-03-03T18:55:04.120ZINFOtest_instance_metrics (InternalApi): set cockroachdb setting setting = cluster.preserve_downgrade_option value = 22.1
15482026-03-03T18:55:04.120ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15492026-03-03T18:55:04.120ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15502026-03-03T18:55:04.121ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15512026-03-03T18:55:04.121ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44650 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15522026-03-03T18:55:04.121ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44652 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15532026-03-03T18:55:04.122ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44650 req_id = 07c34561-c091-4a97-9931-22a4139d9cea sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config
15542026-03-03T18:55:04.122ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44650 req_id = 07c34561-c091-4a97-9931-22a4139d9cea sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config version = 23.0.0
15552026-03-03T18:55:04.122ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44652 req_id = bbbb536a-094e-497c-95ec-af0a1f4b0123 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
15562026-03-03T18:55:04.122ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44652 req_id = bbbb536a-094e-497c-95ec-af0a1f4b0123 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
15572026-03-03T18:55:04.123ZINFOtest_instance_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpP2GRsR/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15582026-03-03T18:55:04.123ZDEBGtest_instance_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpP2GRsR/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15592026-03-03T18:55:04.123ZINFOtest_instance_metrics (ArtifactStore): No ledger in /var/tmp/omicron_tmp/.tmpb9FdIk/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15602026-03-03T18:55:04.123ZDEBGtest_instance_metrics (ArtifactStore): Failed to read ledger: Not found in storage path = /var/tmp/omicron_tmp/.tmpb9FdIk/artifact-config.json server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15612026-03-03T18:55:04.123ZINFOtest_instance_metrics (ArtifactStore): Writing ledger to /var/tmp/omicron_tmp/.tmpP2GRsR/.artifact-config.json.tmp server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15622026-03-03T18:55:04.123ZINFOtest_instance_metrics (dropshot): request completed latency_us = 418 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44652 req_id = bbbb536a-094e-497c-95ec-af0a1f4b0123 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
15632026-03-03T18:55:04.123ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:37139/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbbb536a-094e-497c-95ec-af0a1f4b0123", "content-length": "2", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15642026-03-03T18:55:04.123ZINFOtest_instance_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
15652026-03-03T18:55:04.123ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
15662026-03-03T18:55:04.123ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = SimGimlet00
15672026-03-03T18:55:04.123ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 1.427906846s iteration = 1 status = {}
15682026-03-03T18:55:04.123ZINFOtest_instance_metrics (ArtifactStore): Writing ledger to /var/tmp/omicron_tmp/.tmpb9FdIk/.artifact-config.json.tmp server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15692026-03-03T18:55:04.124ZINFOtest_instance_metrics (ArtifactStore): Starting delete reconciler generation = 1 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
15702026-03-03T18:55:04.124ZINFOtest_instance_metrics (dropshot): request completed latency_us = 1875 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44650 req_id = 07c34561-c091-4a97-9931-22a4139d9cea response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts-config
15712026-03-03T18:55:04.124ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
15722026-03-03T18:55:04.124ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
15732026-03-03T18:55:04.124ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15742026-03-03T18:55:04.124ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15752026-03-03T18:55:04.125ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15762026-03-03T18:55:04.125ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "eba0b8f7-a8d9-4569-b215-c7615fe509d3", "content-length": "835", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15772026-03-03T18:55:04.125ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0
15782026-03-03T18:55:04.126ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[::1]:37139/artifacts-config", status: 204, headers: {"x-request-id": "07c34561-c091-4a97-9931-22a4139d9cea", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15792026-03-03T18:55:04.126ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication body = None method = GET uri = http://[::1]:37139/artifacts
15802026-03-03T18:55:04.126ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44650 req_id = ef4f2f02-8395-4557-ae3c-3170de6c6ef8 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts
15812026-03-03T18:55:04.126ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44650 req_id = ef4f2f02-8395-4557-ae3c-3170de6c6ef8 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts version = 23.0.0
15822026-03-03T18:55:04.126ZINFOtest_instance_metrics (dropshot): request completed latency_us = 218 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44650 req_id = ef4f2f02-8395-4557-ae3c-3170de6c6ef8 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /artifacts
15832026-03-03T18:55:04.127ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[::1]:37139/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef4f2f02-8395-4557-ae3c-3170de6c6ef8", "content-length": "26", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15842026-03-03T18:55:04.127ZINFOtest_instance_metrics (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication sled = http://[::1]:37139
15852026-03-03T18:55:04.130ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 1.426939744s iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"b6d65341-167c-41df-9b5c-41cded99c229","time":"2026-03-03T18:55:04.126020988Z"},{"operation":"list","target_sled":"b6d65341-167c-41df-9b5c-41cded99c229","time":"2026-03-03T18:55:04.127059910Z"}]}
15862026-03-03T18:55:04.130ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872026-03-03T18:55:04.134ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
15882026-03-03T18:55:04.134ZDEBGtest_instance_metrics (InternalApi): updating rack subnet for rack c19a698f-c6f9-4a17-ae30-20d711b8f7dc to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), )
15892026-03-03T18:55:04.134ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
15902026-03-03T18:55:04.134ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
15912026-03-03T18:55:04.135ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
15922026-03-03T18:55:04.136ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15932026-03-03T18:55:04.142ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15942026-03-03T18:55:04.142ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "Vpc" using built-in user background_task = service_firewall_rule_propagation
15952026-03-03T18:55:04.142ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
15962026-03-03T18:55:04.142ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15972026-03-03T18:55:04.142ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15982026-03-03T18:55:04.144ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e24602a2-4697-43de-82dd-5b0429051636", "content-length": "734", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
15992026-03-03T18:55:04.144ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=0
16002026-03-03T18:55:04.146ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "92882d4a-d427-4ca1-8285-f9450d83c6d6", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16012026-03-03T18:55:04.146ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=1
16022026-03-03T18:55:04.147ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16032026-03-03T18:55:04.147ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16042026-03-03T18:55:04.147ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16052026-03-03T18:55:04.148ZINFOtest_instance_metrics (InternalApi): Using static configuration for external switchports
16062026-03-03T18:55:04.148ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
16072026-03-03T18:55:04.148ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
16082026-03-03T18:55:04.148ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
16092026-03-03T18:55:04.149ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e4e1b96-ec3c-405f-9d81-bb8ebc61d950", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16102026-03-03T18:55:04.149ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=0
16112026-03-03T18:55:04.150ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cad3d85-19e4-4236-9719-aae1606ba11c", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16122026-03-03T18:55:04.150ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=1
16132026-03-03T18:55:04.151ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9dc459b-c6d2-4a84-8263-8f19749615fe", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16142026-03-03T18:55:04.151ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=0
16152026-03-03T18:55:04.152ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c426897e-6677-4521-811e-5a349c26b605", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16162026-03-03T18:55:04.152ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=1
16172026-03-03T18:55:04.152ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e559ddf6-c46a-405e-bd4d-eaa73d66bed0", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16182026-03-03T18:55:04.152ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cmpa
16192026-03-03T18:55:04.153ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "42a7df3b-4d18-4cfc-bdeb-98f5f27a69cd", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16202026-03-03T18:55:04.153ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cfpa
16212026-03-03T18:55:04.154ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c172f795-15bc-466b-ad79-8fef2e5184d6", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16222026-03-03T18:55:04.154ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cfpa
16232026-03-03T18:55:04.154ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "613602e3-bf98-4bb0-83cf-1f7fa52ac1a8", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16242026-03-03T18:55:04.154ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cfpa
16252026-03-03T18:55:04.155ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16262026-03-03T18:55:04.155ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16272026-03-03T18:55:04.155ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16282026-03-03T18:55:04.156ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0920b9dd-70c4-41c5-8a95-3769f352cd98", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16292026-03-03T18:55:04.156ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1
16302026-03-03T18:55:04.157ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "087c1b08-27df-48c1-9f63-7f21a0f9a4d0", "content-length": "734", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16312026-03-03T18:55:04.157ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=0
16322026-03-03T18:55:04.157ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16332026-03-03T18:55:04.157ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16342026-03-03T18:55:04.158ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16352026-03-03T18:55:04.159ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3bbac8-706e-4db3-a000-47ec69223ef4", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16362026-03-03T18:55:04.159ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=1
16372026-03-03T18:55:04.161ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
16382026-03-03T18:55:04.161ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16392026-03-03T18:55:04.161ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16402026-03-03T18:55:04.161ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16412026-03-03T18:55:04.161ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16422026-03-03T18:55:04.161ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "863a6240-7776-468d-993b-2540118808c6", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16432026-03-03T18:55:04.161ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=0
16442026-03-03T18:55:04.162ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "13cfeaca-275b-4357-92fd-87a47e1c5ec5", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16452026-03-03T18:55:04.162ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=1
16462026-03-03T18:55:04.162ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "86a427d3-3e98-4a74-8bba-3add96b88f20", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16472026-03-03T18:55:04.162ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=0
16482026-03-03T18:55:04.163ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21318622-13c3-439d-aa02-1fee1cafe3ea", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16492026-03-03T18:55:04.163ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=1
16502026-03-03T18:55:04.164ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16512026-03-03T18:55:04.164ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16522026-03-03T18:55:04.164ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16532026-03-03T18:55:04.164ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16542026-03-03T18:55:04.165ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16552026-03-03T18:55:04.165ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16562026-03-03T18:55:04.165ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16572026-03-03T18:55:04.166ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16582026-03-03T18:55:04.174ZINFOtest_instance_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
16592026-03-03T18:55:04.174ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/eip-gateways
16602026-03-03T18:55:04.174ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44648 req_id = fbc6ec8d-4827-476a-b4e8-4fef7a82d3aa sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
16612026-03-03T18:55:04.174ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44648 req_id = fbc6ec8d-4827-476a-b4e8-4fef7a82d3aa sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
16622026-03-03T18:55:04.174ZINFOtest_instance_metrics (dropshot): request completed latency_us = 275 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44648 req_id = fbc6ec8d-4827-476a-b4e8-4fef7a82d3aa response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
16632026-03-03T18:55:04.174ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16642026-03-03T18:55:04.180ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
16652026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
16662026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
16672026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
16682026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16692026-03-03T18:55:04.181ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16702026-03-03T18:55:04.181ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16712026-03-03T18:55:04.181ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/eip-gateways", status: 204, headers: {"x-request-id": "fbc6ec8d-4827-476a-b4e8-4fef7a82d3aa", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16722026-03-03T18:55:04.181ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 1.482118752s iteration = 1 status = {}
16732026-03-03T18:55:04.181ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Dependency
16742026-03-03T18:55:04.181ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
16752026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
16762026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16772026-03-03T18:55:04.181ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
16782026-03-03T18:55:04.181ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16792026-03-03T18:55:04.182ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16802026-03-03T18:55:04.185ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
16812026-03-03T18:55:04.185ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16822026-03-03T18:55:04.185ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16832026-03-03T18:55:04.185ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16842026-03-03T18:55:04.186ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852026-03-03T18:55:04.188ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16862026-03-03T18:55:04.188ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
16872026-03-03T18:55:04.188ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16882026-03-03T18:55:04.188ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
16892026-03-03T18:55:04.188ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16902026-03-03T18:55:04.189ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16912026-03-03T18:55:04.189ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0058cfd8-ca29-40e1-8d6f-617c0211011e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
16922026-03-03T18:55:04.190ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cmpa
16932026-03-03T18:55:04.190ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
16942026-03-03T18:55:04.190ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
16952026-03-03T18:55:04.190ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16962026-03-03T18:55:04.190ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16972026-03-03T18:55:04.191ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16982026-03-03T18:55:04.193ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16992026-03-03T18:55:04.193ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
17002026-03-03T18:55:04.193ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17012026-03-03T18:55:04.193ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17022026-03-03T18:55:04.194ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17032026-03-03T18:55:04.194ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17042026-03-03T18:55:04.194ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17052026-03-03T18:55:04.195ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ac77f6e-01b1-45b5-aa92-920f577d5345", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17062026-03-03T18:55:04.196ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cfpa
17072026-03-03T18:55:04.197ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a6a633c-2815-4f2b-9e9b-0e10ee57eff7", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17082026-03-03T18:55:04.197ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cfpa
17092026-03-03T18:55:04.197ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24bb74ec-90c9-412a-95e3-689add410e95", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17102026-03-03T18:55:04.197ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cfpa
17112026-03-03T18:55:04.198ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b30318d-9249-49bd-b538-f5bcd2e31a73", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17122026-03-03T18:55:04.198ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0
17132026-03-03T18:55:04.199ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "937638c7-cd1b-4d66-b65e-74897db24d1f", "content-length": "723", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17142026-03-03T18:55:04.199ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/host-boot-flash/active-slot
17152026-03-03T18:55:04.199ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba92b655-e317-4090-b180-f21b6f2fe3f2", "content-length": "10", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17162026-03-03T18:55:04.200ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/0
17172026-03-03T18:55:04.200ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bc72959-aa8e-4e30-ac11-f8556468b3be", "content-length": "144", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17182026-03-03T18:55:04.200ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/1
17192026-03-03T18:55:04.201ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb1af3bc-4bb6-4fa5-9e7c-7528bee018e2", "content-length": "147", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17202026-03-03T18:55:04.201ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=0
17212026-03-03T18:55:04.202ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d65af53-d57a-4000-8f69-679c88a5d3ec", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17222026-03-03T18:55:04.202ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=1
17232026-03-03T18:55:04.202ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "12fb06e4-d120-481f-932f-51581279f3b4", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17242026-03-03T18:55:04.202ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=0
17252026-03-03T18:55:04.203ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d37d253-b062-4648-92c2-e5e85c044c01", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17262026-03-03T18:55:04.203ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=1
17272026-03-03T18:55:04.204ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "176296eb-e4bc-475b-9d58-3a055b472896", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17282026-03-03T18:55:04.204ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=0
17292026-03-03T18:55:04.204ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf5adf58-8192-48d9-8d2f-1dc0d42b5292", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17302026-03-03T18:55:04.205ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=1
17312026-03-03T18:55:04.205ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "54c31bb1-05ca-454f-a2f5-5eae35a4b34e", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17322026-03-03T18:55:04.205ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cmpa
17332026-03-03T18:55:04.206ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "23608a5e-0303-4f72-82bd-e3db50ed640e", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17342026-03-03T18:55:04.206ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cfpa
17352026-03-03T18:55:04.207ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6500adcb-3880-4015-bd87-6074a86eeb27", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17362026-03-03T18:55:04.207ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cfpa
17372026-03-03T18:55:04.207ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17382026-03-03T18:55:04.213ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
17392026-03-03T18:55:04.213ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17402026-03-03T18:55:04.213ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17412026-03-03T18:55:04.213ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17422026-03-03T18:55:04.223ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
17432026-03-03T18:55:04.223ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:37139/vpc-routes
17442026-03-03T18:55:04.224ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44654 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
17452026-03-03T18:55:04.226ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17462026-03-03T18:55:04.226ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17472026-03-03T18:55:04.227ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17482026-03-03T18:55:04.228ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44654 req_id = f74ca01a-3370-4f83-8326-f8dcd5b8f801 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
17492026-03-03T18:55:04.228ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44654 req_id = f74ca01a-3370-4f83-8326-f8dcd5b8f801 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
17502026-03-03T18:55:04.229ZINFOtest_instance_metrics (dropshot): request completed latency_us = 488 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44654 req_id = f74ca01a-3370-4f83-8326-f8dcd5b8f801 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
17512026-03-03T18:55:04.229ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17522026-03-03T18:55:04.229ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17532026-03-03T18:55:04.229ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17542026-03-03T18:55:04.232ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "38bb2af1-feeb-4eb8-a633-1f0143e0f81a", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17552026-03-03T18:55:04.232ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cfpa
17562026-03-03T18:55:04.232ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f74ca01a-3370-4f83-8326-f8dcd5b8f801", "content-length": "2", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17572026-03-03T18:55:04.232ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
17582026-03-03T18:55:04.232ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17592026-03-03T18:55:04.232ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17602026-03-03T18:55:04.241ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17612026-03-03T18:55:04.241ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17622026-03-03T18:55:04.242ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17632026-03-03T18:55:04.244ZINFOtest_instance_metrics (InternalApi): Recording Rack Network Configuration
17642026-03-03T18:55:04.244ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
17652026-03-03T18:55:04.244ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
17662026-03-03T18:55:04.245ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
17672026-03-03T18:55:04.245ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17682026-03-03T18:55:04.245ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17692026-03-03T18:55:04.246ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17702026-03-03T18:55:04.247ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
17712026-03-03T18:55:04.253ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
17722026-03-03T18:55:04.253ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17732026-03-03T18:55:04.253ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17742026-03-03T18:55:04.253ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17752026-03-03T18:55:04.256ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b7d5d80-394a-42b0-821b-29a1c0087a14", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17762026-03-03T18:55:04.256ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1
17772026-03-03T18:55:04.256ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
17782026-03-03T18:55:04.256ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17792026-03-03T18:55:04.256ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
17802026-03-03T18:55:04.256ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
17812026-03-03T18:55:04.257ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b8bb609-925c-4ae9-b978-6fba42c2a29e", "content-length": "723", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17822026-03-03T18:55:04.257ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/host-boot-flash/active-slot
17832026-03-03T18:55:04.258ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "910a98ce-5499-438d-a1be-485bebbec292", "content-length": "10", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17842026-03-03T18:55:04.258ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/0
17852026-03-03T18:55:04.259ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1feeaa2-5f95-4430-b108-c3d5bcf963e1", "content-length": "144", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17862026-03-03T18:55:04.259ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/1
17872026-03-03T18:55:04.259ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1800d18e-2268-4970-9e6e-6ac3030808ab", "content-length": "147", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17882026-03-03T18:55:04.259ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=0
17892026-03-03T18:55:04.260ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "420475a7-b797-4aef-aa1c-e428a554e20d", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17902026-03-03T18:55:04.260ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=1
17912026-03-03T18:55:04.261ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e824349-eefd-4cd7-8fbf-2e814f9d3ff7", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17922026-03-03T18:55:04.261ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=0
17932026-03-03T18:55:04.262ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6dbeb59-a9ce-4cce-b40c-17146983b2a6", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17942026-03-03T18:55:04.262ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=1
17952026-03-03T18:55:04.262ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf93e0a5-55b1-4200-830e-d4f2e216b1f6", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
17962026-03-03T18:55:04.262ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=0
17972026-03-03T18:55:04.265ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
17982026-03-03T18:55:04.265ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
17992026-03-03T18:55:04.265ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18002026-03-03T18:55:04.266ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18012026-03-03T18:55:04.268ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18022026-03-03T18:55:04.273ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
18032026-03-03T18:55:04.273ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = service_firewall_rule_propagation
18042026-03-03T18:55:04.273ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
18052026-03-03T18:55:04.273ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
18062026-03-03T18:55:04.273ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
18072026-03-03T18:55:04.273ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18082026-03-03T18:55:04.273ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18092026-03-03T18:55:04.274ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "59282b36-5967-4051-b9fd-e4fadd9a6a16", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18102026-03-03T18:55:04.274ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=1
18112026-03-03T18:55:04.277ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bdbfda0-c128-4fbb-baf9-948e7fd13400", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18122026-03-03T18:55:04.277ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cmpa
18132026-03-03T18:55:04.277ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3f469f9-4846-4a66-a5e2-68fa03d5e199", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18142026-03-03T18:55:04.277ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cfpa
18152026-03-03T18:55:04.277ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
18162026-03-03T18:55:04.277ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
18172026-03-03T18:55:04.277ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18182026-03-03T18:55:04.278ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18192026-03-03T18:55:04.279ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c47e7ed-1946-4241-a289-d658fc12f788", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18202026-03-03T18:55:04.279ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cfpa
18212026-03-03T18:55:04.279ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "66792db2-f05f-44a6-ac9b-2a01cb7048d0", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18222026-03-03T18:55:04.279ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cfpa
18232026-03-03T18:55:04.280ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "df872d99-d7df-4cec-b72f-11ce59a9243d", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18242026-03-03T18:55:04.280ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
18252026-03-03T18:55:04.280ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18262026-03-03T18:55:04.280ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18272026-03-03T18:55:04.280ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18282026-03-03T18:55:04.281ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18292026-03-03T18:55:04.285ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18302026-03-03T18:55:04.285ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
18312026-03-03T18:55:04.285ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18322026-03-03T18:55:04.285ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18332026-03-03T18:55:04.286ZINFOtest_instance_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
18342026-03-03T18:55:04.286ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/eip-gateways
18352026-03-03T18:55:04.286ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44654 req_id = 60d03833-d817-4749-b58e-b27871a112cf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
18362026-03-03T18:55:04.286ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44654 req_id = 60d03833-d817-4749-b58e-b27871a112cf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
18372026-03-03T18:55:04.286ZINFOtest_instance_metrics (dropshot): request completed latency_us = 213 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44654 req_id = 60d03833-d817-4749-b58e-b27871a112cf response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
18382026-03-03T18:55:04.286ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/eip-gateways", status: 204, headers: {"x-request-id": "60d03833-d817-4749-b58e-b27871a112cf", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
18392026-03-03T18:55:04.286ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 105.157138ms iteration = 2 status = {}
18402026-03-03T18:55:04.287ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18412026-03-03T18:55:04.292ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
18422026-03-03T18:55:04.292ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
18432026-03-03T18:55:04.292ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18442026-03-03T18:55:04.292ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18452026-03-03T18:55:04.293ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18462026-03-03T18:55:04.295ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
18472026-03-03T18:55:04.297ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
18482026-03-03T18:55:04.297ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18492026-03-03T18:55:04.297ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18502026-03-03T18:55:04.297ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18512026-03-03T18:55:04.297ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18522026-03-03T18:55:04.300ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18532026-03-03T18:55:04.302ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
18542026-03-03T18:55:04.302ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
18552026-03-03T18:55:04.302ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18562026-03-03T18:55:04.303ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
18572026-03-03T18:55:04.309ZDEBGtest_instance_metrics (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
18582026-03-03T18:55:04.309ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet
18592026-03-03T18:55:04.309ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = service_firewall_rule_propagation resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18602026-03-03T18:55:04.309ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
18612026-03-03T18:55:04.309ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18622026-03-03T18:55:04.309ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18632026-03-03T18:55:04.315ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642026-03-03T18:55:04.318ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
18652026-03-03T18:55:04.318ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database
18662026-03-03T18:55:04.318ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18672026-03-03T18:55:04.320ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18682026-03-03T18:55:04.322ZTRACtest_instance_metrics (service-firewall-rule-progator): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2026-03-03T18:36:54.041040Z, time_modified: 2026-03-03T18:36:54.041040Z, allowed_ips: None } background_task = service_firewall_rule_propagation
18692026-03-03T18:55:04.322ZDEBGtest_instance_metrics (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
18702026-03-03T18:55:04.322ZDEBGtest_instance_metrics (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
18712026-03-03T18:55:04.322ZDEBGtest_instance_metrics (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
18722026-03-03T18:55:04.328ZTRACtest_instance_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
18732026-03-03T18:55:04.328ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18742026-03-03T18:55:04.328ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18752026-03-03T18:55:04.328ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18762026-03-03T18:55:04.329ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18772026-03-03T18:55:04.332ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18782026-03-03T18:55:04.334ZDEBGtest_instance_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
18792026-03-03T18:55:04.334ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18802026-03-03T18:55:04.334ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18812026-03-03T18:55:04.335ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18822026-03-03T18:55:04.338ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0f04909d-6c67-4c7c-901d-b0d4ede10371, lookup_type: ByName("oxide-service-pool-v4") }
18832026-03-03T18:55:04.338ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18842026-03-03T18:55:04.338ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18852026-03-03T18:55:04.338ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18862026-03-03T18:55:04.339ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18872026-03-03T18:55:04.340ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18882026-03-03T18:55:04.344ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0f04909d-6c67-4c7c-901d-b0d4ede10371, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
18892026-03-03T18:55:04.344ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18902026-03-03T18:55:04.344ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18912026-03-03T18:55:04.344ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18922026-03-03T18:55:04.346ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: d45b52f9-4d8c-40ed-94f6-3f47b60c3c00, lookup_type: ByName("oxide-service-pool-v6") }
18932026-03-03T18:55:04.346ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
18942026-03-03T18:55:04.346ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
18952026-03-03T18:55:04.346ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
18962026-03-03T18:55:04.346ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
18972026-03-03T18:55:04.347ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18982026-03-03T18:55:04.357ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: d45b52f9-4d8c-40ed-94f6-3f47b60c3c00, lookup_type: ByName("oxide-service-pool-v6") } result = Ok(())
18992026-03-03T18:55:04.357ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19002026-03-03T18:55:04.357ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19012026-03-03T18:55:04.358ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19022026-03-03T18:55:04.378ZTRACtest_instance_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0f04909d-6c67-4c7c-901d-b0d4ede10371, lookup_type: ByName("oxide-service-pool-v4") }
19032026-03-03T18:55:04.378ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19042026-03-03T18:55:04.378ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19052026-03-03T18:55:04.378ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19062026-03-03T18:55:04.379ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19072026-03-03T18:55:04.381ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19082026-03-03T18:55:04.384ZDEBGtest_instance_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0f04909d-6c67-4c7c-901d-b0d4ede10371, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
19092026-03-03T18:55:04.408ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:37139
19102026-03-03T18:55:04.408ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = http://[::1]:37139 background_task = inventory_collection body = None method = GET uri = http://[::1]:37139/inventory
19112026-03-03T18:55:04.408ZTRACtest_instance_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0f04909d-6c67-4c7c-901d-b0d4ede10371, lookup_type: ByName("oxide-service-pool-v4") }
19122026-03-03T18:55:04.408ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19132026-03-03T18:55:04.408ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19142026-03-03T18:55:04.408ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19152026-03-03T18:55:04.409ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19162026-03-03T18:55:04.409ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44656 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
19172026-03-03T18:55:04.413ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44656 req_id = 3a702dfe-4fa9-493d-b25f-51c17f7b3c8e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
19182026-03-03T18:55:04.413ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44656 req_id = 3a702dfe-4fa9-493d-b25f-51c17f7b3c8e sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
19192026-03-03T18:55:04.415ZINFOtest_instance_metrics (dropshot): request completed latency_us = 1688 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44656 req_id = 3a702dfe-4fa9-493d-b25f-51c17f7b3c8e response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
19202026-03-03T18:55:04.415ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = http://[::1]:37139 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:37139/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a702dfe-4fa9-493d-b25f-51c17f7b3c8e", "content-length": "20607", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
19212026-03-03T18:55:04.416ZDEBGtest_instance_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
19222026-03-03T18:55:04.416ZDEBGtest_instance_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
19232026-03-03T18:55:04.417ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
19242026-03-03T18:55:04.417ZDEBGtest_instance_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
19252026-03-03T18:55:04.417ZDEBGtest_instance_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
19262026-03-03T18:55:04.417ZWARNtest_instance_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
19272026-03-03T18:55:04.426ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 509a941e-e250-4e50-988f-821caab8ab38 (omicron_zone)
19282026-03-03T18:55:04.426ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
19292026-03-03T18:55:04.426ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19302026-03-03T18:55:04.429ZDEBGtest_instance_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: 0f04909d-6c67-4c7c-901d-b0d4ede10371, lookup_type: ByName("oxide-service-pool-v4") } result = Ok(())
19312026-03-03T18:55:04.430ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
19322026-03-03T18:55:04.430ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
19332026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 8ff0765f-f33e-4be2-8577-bdf01f7d3c22 (omicron_zone)
19342026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43761 method = GET uri = http://[::1]:43761/config
19352026-03-03T18:55:04.442ZINFOtest_instance_metrics (http): accepted connection kind = dns local_addr = [::1]:43761 remote_addr = [::1]:34070
19362026-03-03T18:55:04.442ZTRACtest_instance_metrics (http): incoming request kind = dns local_addr = [::1]:43761 method = GET remote_addr = [::1]:34070 req_id = 18b2fc2d-4de7-4451-a526-9c24ba0325d8 uri = /config
19372026-03-03T18:55:04.442ZDEBGtest_instance_metrics (http): determined request API version kind = dns local_addr = [::1]:43761 method = GET remote_addr = [::1]:34070 req_id = 18b2fc2d-4de7-4451-a526-9c24ba0325d8 uri = /config version = 2.0.0
19382026-03-03T18:55:04.442ZINFOtest_instance_metrics (http): request completed kind = dns latency_us = 530 local_addr = [::1]:43761 method = GET remote_addr = [::1]:34070 req_id = 18b2fc2d-4de7-4451-a526-9c24ba0325d8 response_code = 200 uri = /config
19392026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43761 result = Ok(Response { url: "http://[::1]:43761/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "18b2fc2d-4de7-4451-a526-9c24ba0325d8", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
19402026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 8ff0765f-f33e-4be2-8577-bdf01f7d3c22 (omicron_zone)
19412026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
19422026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): finished collection background_task = inventory_collection
19432026-03-03T18:55:04.442ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
19442026-03-03T18:55:04.442ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19452026-03-03T18:55:04.442ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
19462026-03-03T18:55:04.442ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19472026-03-03T18:55:04.443ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
19482026-03-03T18:55:04.443ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19492026-03-03T18:55:04.447ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
19502026-03-03T18:55:04.447ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
19512026-03-03T18:55:04.447ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19522026-03-03T18:55:04.447ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
19532026-03-03T18:55:04.457ZDEBGtest_instance_metrics (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
19542026-03-03T18:55:04.457ZDEBGtest_instance_metrics (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
19552026-03-03T18:55:04.457ZINFOtest_instance_metrics (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation
19562026-03-03T18:55:04.457ZDEBGtest_instance_metrics (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.758226943s
19572026-03-03T18:55:04.457ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.758252853s iteration = 1 status = {}
19582026-03-03T18:55:04.457ZTRACtest_instance_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: d45b52f9-4d8c-40ed-94f6-3f47b60c3c00, lookup_type: ByName("oxide-service-pool-v6") }
19592026-03-03T18:55:04.457ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19602026-03-03T18:55:04.457ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19612026-03-03T18:55:04.457ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19622026-03-03T18:55:04.458ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19632026-03-03T18:55:04.460ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19642026-03-03T18:55:04.463ZDEBGtest_instance_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = IpPool { parent: Fleet, key: d45b52f9-4d8c-40ed-94f6-3f47b60c3c00, lookup_type: ByName("oxide-service-pool-v6") } result = Ok(())
19652026-03-03T18:55:04.485ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
19662026-03-03T18:55:04.485ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19672026-03-03T18:55:04.486ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19682026-03-03T18:55:04.486ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19692026-03-03T18:55:04.486ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19702026-03-03T18:55:04.488ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19712026-03-03T18:55:04.491ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
19722026-03-03T18:55:04.589ZINFOtest_instance_metrics (InternalApi): inserted blueprint blueprint_id = 8a08b32b-d851-4895-8ae4-dfff04793931
19732026-03-03T18:55:04.589ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig
19742026-03-03T18:55:04.589ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19752026-03-03T18:55:04.589ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19762026-03-03T18:55:04.589ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19772026-03-03T18:55:04.589ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19782026-03-03T18:55:04.589ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792026-03-03T18:55:04.591ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = BlueprintConfig result = Ok(())
19802026-03-03T18:55:04.604ZINFOtest_instance_metrics (InternalApi): No networking records needed for cockroach_db service
19812026-03-03T18:55:04.623ZINFOtest_instance_metrics (InternalApi): Inserted networking records for boundary_ntp service
19822026-03-03T18:55:04.623ZINFOtest_instance_metrics (InternalApi): No networking records needed for internal_dns service
19832026-03-03T18:55:04.634ZINFOtest_instance_metrics (InternalApi): Inserted networking records for nexus service
19842026-03-03T18:55:04.634ZINFOtest_instance_metrics (InternalApi): No networking records needed for clickhouse service
19852026-03-03T18:55:04.645ZINFOtest_instance_metrics (InternalApi): Inserted networking records for external_dns service
19862026-03-03T18:55:04.645ZINFOtest_instance_metrics (InternalApi): No networking records needed for crucible_pantry service
19872026-03-03T18:55:04.645ZINFOtest_instance_metrics (InternalApi): Inserted service networking records
19882026-03-03T18:55:04.645ZINFOtest_instance_metrics (InternalApi): Inserted physical disks
19892026-03-03T18:55:04.645ZINFOtest_instance_metrics (InternalApi): Inserted zpools
19902026-03-03T18:55:04.645ZINFOtest_instance_metrics (InternalApi): Inserted datasets
19912026-03-03T18:55:04.656ZINFOtest_instance_metrics (InternalApi): Populated DNS tables for internal DNS
19922026-03-03T18:55:04.657ZINFOtest_instance_metrics (InternalApi): Populated DNS tables for external DNS
19932026-03-03T18:55:04.658ZTRACtest_instance_metrics (InternalApi): authorize begin action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
19942026-03-03T18:55:04.658ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
19952026-03-03T18:55:04.658ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
19962026-03-03T18:55:04.658ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
19972026-03-03T18:55:04.658ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
19982026-03-03T18:55:04.660ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992026-03-03T18:55:04.665ZDEBGtest_instance_metrics (InternalApi): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
20002026-03-03T18:55:04.665ZTRACtest_instance_metrics (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
20012026-03-03T18:55:04.665ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20022026-03-03T18:55:04.665ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20032026-03-03T18:55:04.665ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20042026-03-03T18:55:04.665ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20052026-03-03T18:55:04.668ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062026-03-03T18:55:04.670ZDEBGtest_instance_metrics (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
20072026-03-03T18:55:04.698ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
20082026-03-03T18:55:04.698ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20092026-03-03T18:55:04.698ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20102026-03-03T18:55:04.698ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20112026-03-03T18:55:04.699ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20122026-03-03T18:55:04.701ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20132026-03-03T18:55:04.707ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
20142026-03-03T18:55:04.707ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
20152026-03-03T18:55:04.707ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20162026-03-03T18:55:04.707ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20172026-03-03T18:55:04.707ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20182026-03-03T18:55:04.707ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20192026-03-03T18:55:04.710ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202026-03-03T18:55:04.715ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
20212026-03-03T18:55:04.717ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig
20222026-03-03T18:55:04.717ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20232026-03-03T18:55:04.717ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20242026-03-03T18:55:04.717ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20252026-03-03T18:55:04.717ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20262026-03-03T18:55:04.721ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20272026-03-03T18:55:04.727ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = DnsConfig result = Ok(())
20282026-03-03T18:55:04.734ZINFOtest_instance_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 790352ca-008c-4303-b711-f67505749472
20292026-03-03T18:55:04.734ZDEBGtest_instance_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 790352ca-008c-4303-b711-f67505749472 time_started = 2026-03-03 18:55:04.089452 UTC
20302026-03-03T18:55:04.734ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 945.236223ms iteration = 2 status = {"collection_id":"790352ca-008c-4303-b711-f67505749472","time_done":"2026-03-03 18:55:04.441072 UTC","time_started":"2026-03-03 18:55:04.089452 UTC"}
20312026-03-03T18:55:04.734ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 2 reason = Dependency
20322026-03-03T18:55:04.734ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
20332026-03-03T18:55:04.734ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20342026-03-03T18:55:04.734ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
20352026-03-03T18:55:04.734ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
20362026-03-03T18:55:04.735ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20372026-03-03T18:55:04.737ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20382026-03-03T18:55:04.741ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
20392026-03-03T18:55:04.742ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
20402026-03-03T18:55:04.742ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
20412026-03-03T18:55:04.742ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20422026-03-03T18:55:04.743ZINFOtest_instance_metrics (InternalApi): Created recovery silo
20432026-03-03T18:55:04.743ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
20442026-03-03T18:55:04.743ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
20452026-03-03T18:55:04.744ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
20462026-03-03T18:55:04.745ZINFOtest_instance_metrics (InternalApi): Created recovery user
20472026-03-03T18:55:04.747ZINFOtest_instance_metrics (InternalApi): Created recovery user's password
20482026-03-03T18:55:04.747ZTRACtest_instance_metrics (InternalApi): authorize begin action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 067676fc-bac4-4702-bc83-5da564f24097, lookup_type: ById(067676fc-bac4-4702-bc83-5da564f24097) }
20492026-03-03T18:55:04.747ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 067676fc-bac4-4702-bc83-5da564f24097 resource_type = Silo
20502026-03-03T18:55:04.747ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20512026-03-03T18:55:04.747ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20522026-03-03T18:55:04.748ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20532026-03-03T18:55:04.754ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20542026-03-03T18:55:04.754ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20552026-03-03T18:55:04.754ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20562026-03-03T18:55:04.755ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20572026-03-03T18:55:04.757ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582026-03-03T18:55:04.759ZDEBGtest_instance_metrics (InternalApi): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 067676fc-bac4-4702-bc83-5da564f24097, lookup_type: ById(067676fc-bac4-4702-bc83-5da564f24097) } result = Ok(())
20592026-03-03T18:55:04.759ZDEBGtest_instance_metrics (InternalApi): Generated role assignment queries
20602026-03-03T18:55:04.764ZINFOtest_instance_metrics (InternalApi): Granted Silo privileges
20612026-03-03T18:55:04.764ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
20622026-03-03T18:55:04.764ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20632026-03-03T18:55:04.764ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20642026-03-03T18:55:04.764ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20652026-03-03T18:55:04.764ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20662026-03-03T18:55:04.767ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672026-03-03T18:55:04.769ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
20682026-03-03T18:55:04.770ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
20692026-03-03T18:55:04.770ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20702026-03-03T18:55:04.770ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20712026-03-03T18:55:04.770ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20722026-03-03T18:55:04.771ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20732026-03-03T18:55:04.772ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742026-03-03T18:55:04.775ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
20752026-03-03T18:55:04.776ZTRACtest_instance_metrics (InternalApi): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
20762026-03-03T18:55:04.776ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20772026-03-03T18:55:04.776ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
20782026-03-03T18:55:04.776ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
20792026-03-03T18:55:04.776ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
20802026-03-03T18:55:04.789ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20812026-03-03T18:55:04.793ZDEBGtest_instance_metrics (InternalApi): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
20822026-03-03T18:55:04.813ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
20832026-03-03T18:55:04.813ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20842026-03-03T18:55:04.813ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
20852026-03-03T18:55:04.813ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20862026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20872026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
20882026-03-03T18:55:04.815ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal
20892026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
20902026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20912026-03-03T18:55:04.815ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
20922026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20932026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20942026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
20952026-03-03T18:55:04.815ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal
20962026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
20972026-03-03T18:55:04.815ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
20982026-03-03T18:55:04.815ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
20992026-03-03T18:55:04.815ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
21002026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21012026-03-03T18:55:04.815ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
21022026-03-03T18:55:04.816ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Signaled
21032026-03-03T18:55:04.816ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
21042026-03-03T18:55:04.816ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21052026-03-03T18:55:04.816ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
21062026-03-03T18:55:04.816ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21072026-03-03T18:55:04.816ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
21082026-03-03T18:55:04.816ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Signaled
21092026-03-03T18:55:04.816ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig
21102026-03-03T18:55:04.816ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21112026-03-03T18:55:04.816ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21122026-03-03T18:55:04.816ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21132026-03-03T18:55:04.817ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21142026-03-03T18:55:04.818ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
21152026-03-03T18:55:04.818ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21162026-03-03T18:55:04.818ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
21172026-03-03T18:55:04.818ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21182026-03-03T18:55:04.818ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21192026-03-03T18:55:04.819ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
21202026-03-03T18:55:04.819ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21212026-03-03T18:55:04.819ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
21222026-03-03T18:55:04.819ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21232026-03-03T18:55:04.820ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21242026-03-03T18:55:04.820ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21252026-03-03T18:55:04.825ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21262026-03-03T18:55:04.828ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272026-03-03T18:55:04.831ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21282026-03-03T18:55:04.831ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
21292026-03-03T18:55:04.831ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21302026-03-03T18:55:04.831ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
21312026-03-03T18:55:04.831ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21322026-03-03T18:55:04.844ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
21332026-03-03T18:55:04.844ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
21342026-03-03T18:55:04.844ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21352026-03-03T18:55:04.844ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
21362026-03-03T18:55:04.846ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21372026-03-03T18:55:04.850ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21382026-03-03T18:55:04.850ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21392026-03-03T18:55:04.850ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21402026-03-03T18:55:04.851ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21412026-03-03T18:55:04.852ZTRACtest_instance_metrics (dns): buffer buffer = Length: 75 (0x4b) bytes\n0000: f5 29 01 00 00 01 00 00 00 00 00 01 0c 5f 6e 61 .)..........._na\n0010: 6d 65 73 65 72 76 69 63 65 04 5f 74 63 70 0d 63 meservice._tcp.c\n0020: 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 ontrol-plane.oxi\n0030: 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 de.internal..!..\n0040: 00 00 29 04 d0 00 00 00 00 00 00 ..)........ kind = dns peer_addr = [::1]:59532 req_id = aa877989-b8e8-4f3e-9655-fc7b66a9b37b
21422026-03-03T18:55:04.852ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 62761,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_nameservice._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_nameservice._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 12,\n 95,\n 110,\n 97,\n 109,\n 101,\n 115,\n 101,\n 114,\n 118,\n 105,\n 99,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59532 req_id = aa877989-b8e8-4f3e-9655-fc7b66a9b37b
21432026-03-03T18:55:04.852ZDEBGtest_instance_metrics (store): query key key = _nameservice._tcp
21442026-03-03T18:55:04.852ZDEBGtest_instance_metrics (store): query key key = 8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host
21452026-03-03T18:55:04.852ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:59532 query = LowerQuery { name: LowerName(Name("_nameservice._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43761, target: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal") }) }] req_id = aa877989-b8e8-4f3e-9655-fc7b66a9b37b
21462026-03-03T18:55:04.852ZTRACtest_instance_metrics (dns): buffer buffer = Length: 76 (0x4c) bytes\n0000: dc d5 01 00 00 01 00 00 00 00 00 01 0d 5f 65 78 ............._ex\n0010: 74 65 72 6e 61 6c 2d 64 6e 73 04 5f 74 63 70 0d ternal-dns._tcp.\n0020: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0030: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 ide.internal..!.\n0040: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:21015 req_id = 2ac7ada1-559e-4e82-b2ab-0be9a759222c
21472026-03-03T18:55:04.852ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56533,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_external-dns._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_external-dns._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 13,\n 95,\n 101,\n 120,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 45,\n 100,\n 110,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:21015 req_id = 2ac7ada1-559e-4e82-b2ab-0be9a759222c
21482026-03-03T18:55:04.852ZDEBGtest_instance_metrics (store): query key key = _external-dns._tcp
21492026-03-03T18:55:04.852ZDEBGtest_instance_metrics (store): query key key = ea089734-1711-4991-8e09-9016d0edd1ed.host
21502026-03-03T18:55:04.852ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:21015 query = LowerQuery { name: LowerName(Name("_external-dns._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41835, target: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal") }) }] req_id = 2ac7ada1-559e-4e82-b2ab-0be9a759222c
21512026-03-03T18:55:04.853ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 43761, target: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 118015980 } })
21522026-03-03T18:55:04.853ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
21532026-03-03T18:55:04.853ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41835, target: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 118278280 } })
21542026-03-03T18:55:04.853ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
21552026-03-03T18:55:04.853ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562026-03-03T18:55:04.858ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21572026-03-03T18:55:04.858ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8a08b32b-d851-4895-8ae4-dfff04793931, lookup_type: ById(8a08b32b-d851-4895-8ae4-dfff04793931) }
21582026-03-03T18:55:04.858ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21592026-03-03T18:55:04.858ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21602026-03-03T18:55:04.858ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21612026-03-03T18:55:04.859ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21622026-03-03T18:55:04.860ZDEBGtest_instance_metrics (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(790352ca-008c-4303-b711-f67505749472, 2)]
21632026-03-03T18:55:04.860ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal
21642026-03-03T18:55:04.860ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig
21652026-03-03T18:55:04.860ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
21662026-03-03T18:55:04.860ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
21672026-03-03T18:55:04.860ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21682026-03-03T18:55:04.860ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
21692026-03-03T18:55:04.860ZTRACtest_instance_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: d4 64 01 00 00 01 00 00 00 00 00 01 24 38 66 66 .d..........$8ff\n0010: 30 37 36 35 66 2d 66 33 33 65 2d 34 62 65 32 2d 0765f-f33e-4be2-\n0020: 38 35 37 37 2d 62 64 66 30 31 66 37 64 33 63 32 8577-bdf01f7d3c2\n0030: 32 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 2.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:40421 req_id = 61e64603-4e32-4eba-946a-e1595089ea08
21702026-03-03T18:55:04.861ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 54372,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 56,\n 102,\n 102,\n 48,\n 55,\n 54,\n 53,\n 102,\n 45,\n 102,\n 51,\n 51,\n 101,\n 45,\n 52,\n 98,\n 101,\n 50,\n 45,\n 56,\n 53,\n 55,\n 55,\n 45,\n 98,\n 100,\n 102,\n 48,\n 49,\n 102,\n 55,\n 100,\n 51,\n 99,\n 50,\n 50,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:40421 req_id = 61e64603-4e32-4eba-946a-e1595089ea08
21712026-03-03T18:55:04.861ZDEBGtest_instance_metrics (store): query key key = 8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host
21722026-03-03T18:55:04.861ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:40421 query = LowerQuery { name: LowerName(Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal.")), original: Query { name: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("8ff0765f-f33e-4be2-8577-bdf01f7d3c22.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 61e64603-4e32-4eba-946a-e1595089ea08
21732026-03-03T18:55:04.861ZTRACtest_instance_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: d1 2c 01 00 00 01 00 00 00 00 00 01 24 65 61 30 .,..........$ea0\n0010: 38 39 37 33 34 2d 31 37 31 31 2d 34 39 39 31 2d 89734-1711-4991-\n0020: 38 65 30 39 2d 39 30 31 36 64 30 65 64 64 31 65 8e09-9016d0edd1e\n0030: 64 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 d.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:57939 req_id = 89101bf7-f8db-4ea4-8a35-6a7772704181
21742026-03-03T18:55:04.861ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 53548,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 101,\n 97,\n 48,\n 56,\n 57,\n 55,\n 51,\n 52,\n 45,\n 49,\n 55,\n 49,\n 49,\n 45,\n 52,\n 57,\n 57,\n 49,\n 45,\n 56,\n 101,\n 48,\n 57,\n 45,\n 57,\n 48,\n 49,\n 54,\n 100,\n 48,\n 101,\n 100,\n 100,\n 49,\n 101,\n 100,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:57939 req_id = 89101bf7-f8db-4ea4-8a35-6a7772704181
21752026-03-03T18:55:04.861ZDEBGtest_instance_metrics (store): query key key = ea089734-1711-4991-8e09-9016d0edd1ed.host
21762026-03-03T18:55:04.861ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:57939 query = LowerQuery { name: LowerName(Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal.")), original: Query { name: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("ea089734-1711-4991-8e09-9016d0edd1ed.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 89101bf7-f8db-4ea4-8a35-6a7772704181
21772026-03-03T18:55:04.861ZTRACtest_instance_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: fd 99 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:18407 req_id = 840c1c60-12f5-44f6-9391-5721afd88270
21782026-03-03T18:55:04.861ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 64921,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:18407 req_id = 840c1c60-12f5-44f6-9391-5721afd88270
21792026-03-03T18:55:04.861ZDEBGtest_instance_metrics (store): query key key = _mgs._tcp
21802026-03-03T18:55:04.861ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
21812026-03-03T18:55:04.861ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:18407 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 35581, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 840c1c60-12f5-44f6-9391-5721afd88270
21822026-03-03T18:55:04.861ZINFOtest_instance_metrics (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:43761] } background_task = dns_servers_internal dns_group = internal
21832026-03-03T18:55:04.861ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 47.330216ms iteration = 2 status = {"addresses":["[::1]:43761"]}
21842026-03-03T18:55:04.861ZINFOtest_instance_metrics (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[::1]:41835] } background_task = dns_servers_external dns_group = external
21852026-03-03T18:55:04.861ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 46.556565ms iteration = 2 status = {"addresses":["[::1]:41835"]}
21862026-03-03T18:55:04.862ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 35581, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 126630894 } })
21872026-03-03T18:55:04.862ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
21882026-03-03T18:55:04.862ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
21892026-03-03T18:55:04.862ZWARNtest_instance_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal reason = no config
21902026-03-03T18:55:04.862ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 30.47\u{b5}s iteration = 2 status = {"error":"no config"}
21912026-03-03T18:55:04.862ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
21922026-03-03T18:55:04.862ZWARNtest_instance_metrics (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external reason = no config
21932026-03-03T18:55:04.862ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 5.6\u{b5}s iteration = 2 status = {"error":"no config"}
21942026-03-03T18:55:04.862ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21952026-03-03T18:55:04.866ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8a08b32b-d851-4895-8ae4-dfff04793931, lookup_type: ById(8a08b32b-d851-4895-8ae4-dfff04793931) } result = Ok(())
21962026-03-03T18:55:04.868ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database
21972026-03-03T18:55:04.868ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21982026-03-03T18:55:04.868ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_loader resource = Database result = Ok(())
21992026-03-03T18:55:04.868ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22002026-03-03T18:55:04.875ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22012026-03-03T18:55:04.875ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
22022026-03-03T18:55:04.875ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22032026-03-03T18:55:04.875ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
22042026-03-03T18:55:04.875ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 02 9d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:46119 req_id = 003265b5-1842-44eb-b9fa-5590a91f03f6
22052026-03-03T18:55:04.875ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 669,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:46119 req_id = 003265b5-1842-44eb-b9fa-5590a91f03f6
22062026-03-03T18:55:04.875ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
22072026-03-03T18:55:04.875ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:46119 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 003265b5-1842-44eb-b9fa-5590a91f03f6
22082026-03-03T18:55:04.881ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _clickhouse-admin-keeper._tcp.control-plane.oxide.internal
22092026-03-03T18:55:04.882ZTRACtest_instance_metrics (dns): buffer buffer = Length: 87 (0x57) bytes\n0000: e5 96 01 00 00 01 00 00 00 00 00 01 18 5f 63 6c ............._cl\n0010: 69 63 6b 68 6f 75 73 65 2d 61 64 6d 69 6e 2d 6b ickhouse-admin-k\n0020: 65 65 70 65 72 04 5f 74 63 70 0d 63 6f 6e 74 72 eeper._tcp.contr\n0030: 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 69 ol-plane.oxide.i\n0040: 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 04 nternal..!....).\n0050: d0 00 00 00 00 00 00 ....... kind = dns peer_addr = [::1]:43509 req_id = 17d74b9a-c45f-40ab-9eec-01e1710e4121
22102026-03-03T18:55:04.882ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58774,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 24,\n 95,\n 99,\n 108,\n 105,\n 99,\n 107,\n 104,\n 111,\n 117,\n 115,\n 101,\n 45,\n 97,\n 100,\n 109,\n 105,\n 110,\n 45,\n 107,\n 101,\n 101,\n 112,\n 101,\n 114,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:43509 req_id = 17d74b9a-c45f-40ab-9eec-01e1710e4121
22112026-03-03T18:55:04.882ZDEBGtest_instance_metrics (store): query key key = _clickhouse-admin-keeper._tcp
22122026-03-03T18:55:04.882ZERROtest_instance_metrics (dns): failed to handle incoming DNS message: MessageRequest { header: Header { id: 58774, message_type: Query, op_code: Query, authoritative: false, truncation: false, recursion_desired: true, recursion_available: false, authentic_data: false, checking_disabled: false, response_code: NoError, query_count: 1, answer_count: 0, name_server_count: 0, additional_count: 1, }, queries: Queries { queries: [ LowerQuery { name: LowerName( Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), ), original: Query { name: Name("_clickhouse-admin-keeper._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN, }, }, ], original: [ 24, 95, 99, 108, 105, 99, 107, 104, 111, 117, 115, 101, 45, 97, 100, 109, 105, 110, 45, 107, 101, 101, 112, 101, 114, 4, 95, 116, 99, 112, 13, 99, 111, 110, 116, 114, 111, 108, 45, 112, 108, 97, 110, 101, 5, 111, 120, 105, 100, 101, 8, 105, 110, 116, 101, 114, 110, 97, 108, 0, 0, 33, 0, 1, ], }, answers: [], name_servers: [], additionals: [], sig0: [], edns: Some( Edns { rcode_high: 0, version: 0, flags: EdnsFlags { dnssec_ok: false, z: 0, }, max_payload: 1232, options: OPT { options: [], }, }, ), } NXDOMAIN: _clickhouse-admin-keeper._tcp.control-plane.oxide.internal kind = dns peer_addr = [::1]:43509 req_id = 17d74b9a-c45f-40ab-9eec-01e1710e4121
22132026-03-03T18:55:04.883ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal
22142026-03-03T18:55:04.883ZTRACtest_instance_metrics (dns): buffer buffer = Length: 73 (0x49) bytes\n0000: c1 6f 01 00 00 01 00 00 00 00 00 01 0a 5f 63 6f .o..........._co\n0010: 63 6b 72 6f 61 63 68 04 5f 74 63 70 0d 63 6f 6e ckroach._tcp.con\n0020: 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 trol-plane.oxide\n0030: 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 .internal..!....\n0040: 29 04 d0 00 00 00 00 00 00 )........ kind = dns peer_addr = [::1]:23928 req_id = b7a4f2c5-8fb2-4c80-bcd8-e90040272703
22152026-03-03T18:55:04.883ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 49519,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_cockroach._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_cockroach._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 10,\n 95,\n 99,\n 111,\n 99,\n 107,\n 114,\n 111,\n 97,\n 99,\n 104,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:23928 req_id = b7a4f2c5-8fb2-4c80-bcd8-e90040272703
22162026-03-03T18:55:04.883ZDEBGtest_instance_metrics (store): query key key = _cockroach._tcp
22172026-03-03T18:55:04.883ZDEBGtest_instance_metrics (store): query key key = 0a42343f-9002-4d6f-a404-abbda9d40103.host
22182026-03-03T18:55:04.883ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:23928 query = LowerQuery { name: LowerName(Name("_cockroach._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41875, target: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal") }) }] req_id = b7a4f2c5-8fb2-4c80-bcd8-e90040272703
22192026-03-03T18:55:04.883ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41875, target: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 148242528 } })
22202026-03-03T18:55:04.883ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
22212026-03-03T18:55:04.883ZTRACtest_instance_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: e3 00 01 00 00 01 00 00 00 00 00 01 24 30 61 34 ............$0a4\n0010: 32 33 34 33 66 2d 39 30 30 32 2d 34 64 36 66 2d 2343f-9002-4d6f-\n0020: 61 34 30 34 2d 61 62 62 64 61 39 64 34 30 31 30 a404-abbda9d4010\n0030: 33 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 3.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:1168 req_id = 1f7e1474-b4ee-43bf-a31f-0c1932fd3495
22222026-03-03T18:55:04.883ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 58112,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 48,\n 97,\n 52,\n 50,\n 51,\n 52,\n 51,\n 102,\n 45,\n 57,\n 48,\n 48,\n 50,\n 45,\n 52,\n 100,\n 54,\n 102,\n 45,\n 97,\n 52,\n 48,\n 52,\n 45,\n 97,\n 98,\n 98,\n 100,\n 97,\n 57,\n 100,\n 52,\n 48,\n 49,\n 48,\n 51,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1168 req_id = 1f7e1474-b4ee-43bf-a31f-0c1932fd3495
22232026-03-03T18:55:04.883ZDEBGtest_instance_metrics (store): query key key = 0a42343f-9002-4d6f-a404-abbda9d40103.host
22242026-03-03T18:55:04.883ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:1168 query = LowerQuery { name: LowerName(Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal.")), original: Query { name: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("0a42343f-9002-4d6f-a404-abbda9d40103.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 1f7e1474-b4ee-43bf-a31f-0c1932fd3495
22252026-03-03T18:55:04.884ZDEBGtest_instance_metrics (BackgroundTasks): begin collection background_task = inventory_collection
22262026-03-03T18:55:04.884ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[::1]:35581
22272026-03-03T18:55:04.884ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/ignition
22282026-03-03T18:55:04.886ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb661f39-b82e-4dd8-8a63-e7633eb616b2", "content-length": "835", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
22292026-03-03T18:55:04.886ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0
22302026-03-03T18:55:04.888ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd2c060-9557-4345-be63-722863c9a0ff", "content-length": "734", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
22312026-03-03T18:55:04.888ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=0
22322026-03-03T18:55:04.905ZDEBGtest_instance_metrics (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22332026-03-03T18:55:04.905ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22342026-03-03T18:55:04.905ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22352026-03-03T18:55:04.905ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
22362026-03-03T18:55:04.906ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22372026-03-03T18:55:04.906ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
22382026-03-03T18:55:04.906ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22392026-03-03T18:55:04.907ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22402026-03-03T18:55:04.909ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfa5206f-3be4-4db1-9be1-473867d9d304", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:04 GMT"} })
22412026-03-03T18:55:04.909ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=1
22422026-03-03T18:55:04.909ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22432026-03-03T18:55:04.917ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22442026-03-03T18:55:04.917ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
22452026-03-03T18:55:04.917ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22462026-03-03T18:55:04.917ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22472026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
22482026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 95290e1f-c29a-4573-ac20-78baee21e1fa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22492026-03-03T18:55:04.921ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig
22502026-03-03T18:55:04.921ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_internal dns_group = internal resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22512026-03-03T18:55:04.921ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
22522026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22532026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22542026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 186.011057ms iteration = 2 status = {"Loaded":{"collection_id":"790352ca-008c-4303-b711-f67505749472","time_loaded":"2026-03-03T18:55:04.734580212Z","time_started":"2026-03-03T18:55:04.089452Z"}}
22552026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 2 reason = Dependency
22562026-03-03T18:55:04.921ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
22572026-03-03T18:55:04.921ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
22582026-03-03T18:55:04.921ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
22592026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 3 reason = Dependency
22602026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
22612026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 16.17\u{b5}s iteration = 3 status = "Disabled"
22622026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
22632026-03-03T18:55:04.921ZWARNtest_instance_metrics (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous reason = no blueprint
22642026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 14.35\u{b5}s iteration = 2 status = {"error":"no blueprint"}
22652026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
22662026-03-03T18:55:04.921ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 7.27\u{b5}s iteration = 2 status = {"error":"task disabled"}
22672026-03-03T18:55:04.929ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22682026-03-03T18:55:04.929ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22692026-03-03T18:55:04.929ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database
22702026-03-03T18:55:04.929ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22712026-03-03T18:55:04.929ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22722026-03-03T18:55:04.937ZDEBGtest_instance_metrics (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 95290e1f-c29a-4573-ac20-78baee21e1fa dns_zone_name = control-plane.oxide.internal found_so_far = 27 version = 1
22732026-03-03T18:55:04.937ZDEBGtest_instance_metrics (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
22742026-03-03T18:55:04.937ZINFOtest_instance_metrics (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal generation = 1
22752026-03-03T18:55:04.937ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 124.487459ms iteration = 2 status = {"generation":1}
22762026-03-03T18:55:04.938ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
22772026-03-03T18:55:04.957ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[::1]:43761 generation = 1 method = PUT servers = DnsServersList { addresses: [[::1]:43761] } uri = http://[::1]:43761/config
22782026-03-03T18:55:04.958ZDEBGtest_instance_metrics (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22792026-03-03T18:55:04.958ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22802026-03-03T18:55:04.958ZDEBGtest_instance_metrics (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22812026-03-03T18:55:04.958ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
22822026-03-03T18:55:04.958ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22832026-03-03T18:55:04.958ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
22842026-03-03T18:55:04.958ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22852026-03-03T18:55:04.958ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22862026-03-03T18:55:04.960ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet
22872026-03-03T18:55:04.960ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = external_endpoints resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
22882026-03-03T18:55:04.960ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
22892026-03-03T18:55:04.960ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22902026-03-03T18:55:04.960ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
22912026-03-03T18:55:04.960ZINFOtest_instance_metrics (http): accepted connection kind = dns local_addr = [::1]:43761 remote_addr = [::1]:34072
22922026-03-03T18:55:04.961ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22932026-03-03T18:55:04.965ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22942026-03-03T18:55:04.965ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
22952026-03-03T18:55:04.965ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22962026-03-03T18:55:04.966ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22972026-03-03T18:55:04.967ZDEBGtest_instance_metrics (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22982026-03-03T18:55:04.967ZDEBGtest_instance_metrics (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d2c1b31-d2a0-405e-871c-2e2f9e36c2cd dns_zone_name = oxide-dev.test found_so_far = 0 version = 2
22992026-03-03T18:55:04.967ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig
23002026-03-03T18:55:04.967ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = dns_config_external dns_group = external resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23012026-03-03T18:55:04.967ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
23022026-03-03T18:55:04.967ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23032026-03-03T18:55:04.969ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23042026-03-03T18:55:04.970ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052026-03-03T18:55:04.972ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23062026-03-03T18:55:04.972ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database
23072026-03-03T18:55:04.972ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23082026-03-03T18:55:04.973ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = external_endpoints resource = Database result = Ok(())
23092026-03-03T18:55:04.988ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23102026-03-03T18:55:04.993ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23112026-03-03T18:55:04.993ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database
23122026-03-03T18:55:04.993ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23132026-03-03T18:55:05.013ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23142026-03-03T18:55:05.014ZINFOtest_instance_metrics (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader target_id = 8a08b32b-d851-4895-8ae4-dfff04793931 time_created = 2026-03-03 18:55:03.848123 UTC
23152026-03-03T18:55:05.014ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 198.098937ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"8a08b32b-d851-4895-8ae4-dfff04793931","time_created":"2026-03-03T18:55:03.848123Z","time_found":"2026-03-03T18:55:05.014654030Z"}
23162026-03-03T18:55:05.015ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
23172026-03-03T18:55:05.015ZDEBGtest_instance_metrics (BackgroundTasks): blueprint execution: quiesce check background_task = blueprint_executor quiescing = false
23182026-03-03T18:55:05.015ZINFOtest_instance_metrics (NexusQuiesceHandle): initial state state = Running
23192026-03-03T18:55:05.015ZINFOtest_instance_metrics (SagaQuiesceHandle): initial quiesce state initial_state = Allowed
23202026-03-03T18:55:05.015ZWARNtest_instance_metrics (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor reason = blueprint disabled target_id = 8a08b32b-d851-4895-8ae4-dfff04793931
23212026-03-03T18:55:05.016ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 65.01\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"8a08b32b-d851-4895-8ae4-dfff04793931"}
23222026-03-03T18:55:05.016ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
23232026-03-03T18:55:05.016ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet
23242026-03-03T18:55:05.016ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = crdb_node_id_collector resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23252026-03-03T18:55:05.016ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database
23262026-03-03T18:55:05.016ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23272026-03-03T18:55:05.016ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23282026-03-03T18:55:05.032ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 4 reason = Dependency
23292026-03-03T18:55:05.032ZDEBGtest_instance_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
23302026-03-03T18:55:05.032ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 47.95\u{b5}s iteration = 4 status = "Disabled"
23312026-03-03T18:55:05.032ZTRACtest_instance_metrics (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database
23322026-03-03T18:55:05.032ZDEBGtest_instance_metrics (ServiceBalancer): roles roles = RoleSet { roles: {} }
23332026-03-03T18:55:05.033ZDEBGtest_instance_metrics (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database result = Ok(())
23342026-03-03T18:55:05.034ZTRACtest_instance_metrics (http): incoming request kind = dns local_addr = [::1]:43761 method = PUT remote_addr = [::1]:34072 req_id = 8faef5b7-fd06-4f3c-abb8-7397ab755564 uri = /config
23352026-03-03T18:55:05.034ZDEBGtest_instance_metrics (http): determined request API version kind = dns local_addr = [::1]:43761 method = PUT remote_addr = [::1]:34072 req_id = 8faef5b7-fd06-4f3c-abb8-7397ab755564 uri = /config version = 2.0.0
23362026-03-03T18:55:05.034ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ac a8 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:52844 req_id = 82056859-ee1e-4bee-9f02-e5f7b6fdd4cc
23372026-03-03T18:55:05.034ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 44200,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:52844 req_id = 82056859-ee1e-4bee-9f02-e5f7b6fdd4cc
23382026-03-03T18:55:05.034ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
23392026-03-03T18:55:05.034ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
23402026-03-03T18:55:05.034ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:52844 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 82056859-ee1e-4bee-9f02-e5f7b6fdd4cc
23412026-03-03T18:55:05.034ZINFOtest_instance_metrics (store): attempting generation update new_generation = 1 req_id = 8faef5b7-fd06-4f3c-abb8-7397ab755564
23422026-03-03T18:55:05.035ZINFOtest_instance_metrics (store): updated generation new_generation = 1 req_id = 8faef5b7-fd06-4f3c-abb8-7397ab755564
23432026-03-03T18:55:05.035ZINFOtest_instance_metrics (http): request completed kind = dns latency_us = 1193 local_addr = [::1]:43761 method = PUT remote_addr = [::1]:34072 req_id = 8faef5b7-fd06-4f3c-abb8-7397ab755564 response_code = 204 uri = /config
23442026-03-03T18:55:05.049ZINFOtest_instance_metrics (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2026-03-03T18:55:01.921550Z, time_modified: 2026-03-03T18:55:01.921550Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }, "test-suite-silo.sys.oxide-dev.test": ExternalEndpoint { silo_id: 067676fc-bac4-4702-bc83-5da564f24097, db_silo: Silo { identity: SiloIdentity { id: 067676fc-bac4-4702-bc83-5da564f24097, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2026-03-03T18:55:04.658057Z, time_modified: 2026-03-03T18:55:04.658057Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide-dev.test" }, NoSiloCerts { silo_id: 067676fc-bac4-4702-bc83-5da564f24097, dns_name: "test-suite-silo.sys.oxide-dev.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 067676fc-bac4-4702-bc83-5da564f24097, db_silo: Silo { identity: SiloIdentity { id: 067676fc-bac4-4702-bc83-5da564f24097, name: Name(Name("test-suite-silo")), description: "built-in recovery Silo", time_created: 2026-03-03T18:55:04.658057Z, time_modified: 2026-03-03T18:55:04.658057Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)), admin_group_name: None }, tls_certs: [] }) }
23452026-03-03T18:55:05.050ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 234.524226ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide-dev.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"test-suite-silo.sys.oxide-dev.test":{"silo_id":"067676fc-bac4-4702-bc83-5da564f24097","tls_certs":[]}},"default_endpoint":{"silo_id":"067676fc-bac4-4702-bc83-5da564f24097","tls_certs":[]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide-dev.test\\" has no usable certificates","silo 067676fc-bac4-4702-bc83-5da564f24097 with DNS name \\"test-suite-silo.sys.oxide-dev.test\\" has no usable certificates"]}
23462026-03-03T18:55:05.050ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 315378226 } })
23472026-03-03T18:55:05.050ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
23482026-03-03T18:55:05.050ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23492026-03-03T18:55:05.054ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23502026-03-03T18:55:05.054ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database
23512026-03-03T18:55:05.054ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23522026-03-03T18:55:05.054ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23532026-03-03T18:55:05.059ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3503ad97-1d00-4026-971b-86e5fa982c01", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
23542026-03-03T18:55:05.059ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=0
23552026-03-03T18:55:05.060ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:43761 generation = 1 result = Ok(Response { url: "http://[::1]:43761/config", status: 204, headers: {"x-request-id": "8faef5b7-fd06-4f3c-abb8-7397ab755564", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} }) servers = DnsServersList { addresses: [[::1]:43761] }
23562026-03-03T18:55:05.060ZINFOtest_instance_metrics (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[::1]:43761 generation = 1 servers = DnsServersList { addresses: [[::1]:43761] }
23572026-03-03T18:55:05.060ZINFOtest_instance_metrics (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal generation = 1 servers = DnsServersList { addresses: [[::1]:43761] }
23582026-03-03T18:55:05.060ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 122.390476ms iteration = 3 status = {"generation":1,"server_results":{"[::1]:43761":{"Ok":null}}}
23592026-03-03T18:55:05.063ZDEBGtest_instance_metrics (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d2c1b31-d2a0-405e-871c-2e2f9e36c2cd dns_zone_name = oxide-dev.test found_so_far = 3 version = 2
23602026-03-03T18:55:05.063ZDEBGtest_instance_metrics (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23612026-03-03T18:55:05.063ZINFOtest_instance_metrics (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external generation = 2
23622026-03-03T18:55:05.063ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 248.744308ms iteration = 2 status = {"generation":2}
23632026-03-03T18:55:05.063ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
23642026-03-03T18:55:05.073ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[::1]:41835 generation = 2 method = PUT servers = DnsServersList { addresses: [[::1]:41835] } uri = http://[::1]:41835/config
23652026-03-03T18:55:05.119ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[::1]:32222/node/id
23662026-03-03T18:55:05.121ZINFOtest_instance_metrics (http): accepted connection kind = dns local_addr = [::1]:41835 remote_addr = [::1]:44620
23672026-03-03T18:55:05.121ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
23682026-03-03T18:55:05.121ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 106.854071ms iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone 0a42343f-9002-4d6f-a404-abbda9d40103 at http://[::1]:32222: Communication Error: error sending request for url (http://[::1]:32222/node/id): error sending request for url (http://[::1]:32222/node/id): client error (Connect): tcp connect error: Connection refused (os error 111)","zone_id":"0a42343f-9002-4d6f-a404-abbda9d40103"}],"nsuccess":0}
23692026-03-03T18:55:05.123ZTRACtest_instance_metrics (ServiceBalancer): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) }
23702026-03-03T18:55:05.123ZTRACtest_instance_metrics (ServiceBalancer): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
23712026-03-03T18:55:05.123ZTRACtest_instance_metrics (ServiceBalancer): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database
23722026-03-03T18:55:05.123ZDEBGtest_instance_metrics (ServiceBalancer): roles roles = RoleSet { roles: {} }
23732026-03-03T18:55:05.123ZDEBGtest_instance_metrics (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Database result = Ok(())
23742026-03-03T18:55:05.123ZTRACtest_instance_metrics (http): incoming request kind = dns local_addr = [::1]:41835 method = PUT remote_addr = [::1]:44620 req_id = a4c3e74e-e0b6-4dc9-a2cd-dca0586372f6 uri = /config
23752026-03-03T18:55:05.123ZDEBGtest_instance_metrics (http): determined request API version kind = dns local_addr = [::1]:41835 method = PUT remote_addr = [::1]:44620 req_id = a4c3e74e-e0b6-4dc9-a2cd-dca0586372f6 uri = /config version = 2.0.0
23762026-03-03T18:55:05.124ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 4e 8c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e N...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:45217 req_id = 44c123c8-82df-42c5-a1d5-3ec65b9117c6
23772026-03-03T18:55:05.124ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 20108,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:45217 req_id = 44c123c8-82df-42c5-a1d5-3ec65b9117c6
23782026-03-03T18:55:05.124ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
23792026-03-03T18:55:05.124ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:45217 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 44c123c8-82df-42c5-a1d5-3ec65b9117c6
23802026-03-03T18:55:05.124ZINFOtest_instance_metrics (store): attempting generation update new_generation = 2 req_id = a4c3e74e-e0b6-4dc9-a2cd-dca0586372f6
23812026-03-03T18:55:05.124ZINFOtest_instance_metrics (store): pruning trees for generations newer than 0
23822026-03-03T18:55:05.124ZDEBGtest_instance_metrics (store): creating tree tree_name = generation_2_zone_oxide-dev.test
23832026-03-03T18:55:05.143ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
23842026-03-03T18:55:05.144ZDEBGtest_instance_metrics (store): updating current config
23852026-03-03T18:55:05.144ZDEBGtest_instance_metrics (store): flushing default tree
23862026-03-03T18:55:05.153ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b5f540e-ea97-4619-b28c-9665b7961be1", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
23872026-03-03T18:55:05.153ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
23882026-03-03T18:55:05.153ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
23892026-03-03T18:55:05.153ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
23902026-03-03T18:55:05.153ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
23912026-03-03T18:55:05.153ZINFOtest_instance_metrics (store): pruning trees for generations older than 2 keep = 3
23922026-03-03T18:55:05.153ZINFOtest_instance_metrics (store): updated generation new_generation = 2 req_id = a4c3e74e-e0b6-4dc9-a2cd-dca0586372f6
23932026-03-03T18:55:05.153ZINFOtest_instance_metrics (http): request completed kind = dns latency_us = 23258 local_addr = [::1]:41835 method = PUT remote_addr = [::1]:44620 req_id = a4c3e74e-e0b6-4dc9-a2cd-dca0586372f6 response_code = 204 uri = /config
23942026-03-03T18:55:05.154ZDEBGtest_instance_metrics (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952026-03-03T18:55:05.154ZDEBGtest_instance_metrics (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3 (built_in_user), .. }) resource = Rack { parent: Fleet, key: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, lookup_type: ById(c19a698f-c6f9-4a17-ae30-20d711b8f7dc) } result = Ok(())
23962026-03-03T18:55:05.154ZINFOtest_instance_metrics (nexus): Rack initialized
23972026-03-03T18:55:05.154ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
23982026-03-03T18:55:05.154ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
23992026-03-03T18:55:05.154ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24002026-03-03T18:55:05.154ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:41835 generation = 2 result = Ok(Response { url: "http://[::1]:41835/config", status: 204, headers: {"x-request-id": "a4c3e74e-e0b6-4dc9-a2cd-dca0586372f6", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} }) servers = DnsServersList { addresses: [[::1]:41835] }
24012026-03-03T18:55:05.154ZINFOtest_instance_metrics (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[::1]:41835 generation = 2 servers = DnsServersList { addresses: [[::1]:41835] }
24022026-03-03T18:55:05.154ZINFOtest_instance_metrics (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external generation = 2 servers = DnsServersList { addresses: [[::1]:41835] }
24032026-03-03T18:55:05.154ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 88.569952ms iteration = 3 status = {"generation":2,"server_results":{"[::1]:41835":{"Ok":null}}}
24042026-03-03T18:55:05.160ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "61be27dd-2267-45e5-81fb-6c866ab13e84", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24052026-03-03T18:55:05.160ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=1
24062026-03-03T18:55:05.160ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc168a8d-bab0-4f90-b604-2b38312f7c9a", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24072026-03-03T18:55:05.161ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=0
24082026-03-03T18:55:05.161ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "175cf8ed-57c9-4c3a-9017-8ffb1895ae43", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24092026-03-03T18:55:05.161ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=1
24102026-03-03T18:55:05.161ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b950269-2355-454f-8bca-366d41f11894", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24112026-03-03T18:55:05.161ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cmpa
24122026-03-03T18:55:05.161ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24132026-03-03T18:55:05.161ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24142026-03-03T18:55:05.165ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24152026-03-03T18:55:05.165ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bf6b911-4e9b-43cf-8577-bed3a6306601", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24162026-03-03T18:55:05.165ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cfpa
24172026-03-03T18:55:05.165ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24182026-03-03T18:55:05.165ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24192026-03-03T18:55:05.165ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24202026-03-03T18:55:05.179ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "585b2f36-498d-455a-80c9-a7fc0b79c776", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24212026-03-03T18:55:05.180ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cfpa
24222026-03-03T18:55:05.180ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
24232026-03-03T18:55:05.180ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
24242026-03-03T18:55:05.180ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24252026-03-03T18:55:05.180ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24262026-03-03T18:55:05.180ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24272026-03-03T18:55:05.182ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91dc944f-b79b-45e6-b908-3d56c7f7dbf6", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24282026-03-03T18:55:05.182ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/0/component/rot/cfpa
24292026-03-03T18:55:05.182ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
24302026-03-03T18:55:05.182ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24312026-03-03T18:55:05.182ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24322026-03-03T18:55:05.183ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24332026-03-03T18:55:05.183ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea979521-90a5-4480-ade8-0df232fc31b4", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24342026-03-03T18:55:05.183ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1
24352026-03-03T18:55:05.184ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
24362026-03-03T18:55:05.184ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24372026-03-03T18:55:05.184ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24382026-03-03T18:55:05.185ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24392026-03-03T18:55:05.185ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a26f2bb-3b8f-4b60-9496-fd2eb9472c6d", "content-length": "734", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24402026-03-03T18:55:05.185ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=0
24412026-03-03T18:55:05.186ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f0d398f-2fc0-42ea-a14a-f25d1557d1ab", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24422026-03-03T18:55:05.186ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=1
24432026-03-03T18:55:05.187ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442026-03-03T18:55:05.191ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24452026-03-03T18:55:05.191ZTRACtest_instance_metrics (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
24462026-03-03T18:55:05.191ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
24472026-03-03T18:55:05.191ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
24482026-03-03T18:55:05.191ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24492026-03-03T18:55:05.192ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24502026-03-03T18:55:05.195ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24512026-03-03T18:55:05.197ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "62dd533b-98fc-4eab-b96b-465b13045797", "content-length": "111", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24522026-03-03T18:55:05.197ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=0
24532026-03-03T18:55:05.201ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
24542026-03-03T18:55:05.201ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
24552026-03-03T18:55:05.201ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
24562026-03-03T18:55:05.201ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
24572026-03-03T18:55:05.202ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
24582026-03-03T18:55:05.202ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
24592026-03-03T18:55:05.202ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
24602026-03-03T18:55:05.202ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
24612026-03-03T18:55:05.203ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
24622026-03-03T18:55:05.204ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1794a4fe-fc8a-4b7b-af3f-81b9a5c6f703", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24632026-03-03T18:55:05.204ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=1
24642026-03-03T18:55:05.205ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b78e0ad5-9946-48e6-9bef-d014572c3221", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24652026-03-03T18:55:05.205ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=0
24662026-03-03T18:55:05.205ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "49afc4ba-74a5-4fcb-938d-bdc70ee87117", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24672026-03-03T18:55:05.205ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=1
24682026-03-03T18:55:05.206ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c1250e2-1f8c-4fa3-8364-1bde6fdeb8bd", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24692026-03-03T18:55:05.206ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cmpa
24702026-03-03T18:55:05.207ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3160007b-47ec-4f1e-b77e-5e7e27d79776", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24712026-03-03T18:55:05.207ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cfpa
24722026-03-03T18:55:05.207ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86dd96de-f312-41de-9f32-aa524a7f45a9", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24732026-03-03T18:55:05.207ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cfpa
24742026-03-03T18:55:05.208ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd05dcec-e76a-474d-9577-b7c349daf261", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24752026-03-03T18:55:05.208ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/switch/1/component/rot/cfpa
24762026-03-03T18:55:05.208ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/switch/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f296f390-4654-486d-968c-df6654e2f60f", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24772026-03-03T18:55:05.208ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0
24782026-03-03T18:55:05.221ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "378f4fe4-3165-4b3e-851a-b5b792c1b4f7", "content-length": "723", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24792026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/host-boot-flash/active-slot
24802026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "2124a504-8c05-414d-80f6-c375ff2ecf49", "content-length": "10", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24812026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/0
24822026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "94278910-f809-4bdc-950b-ff85142a4af4", "content-length": "144", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24832026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/1
24842026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "858ffe83-bf1a-4878-bd1e-8e1f45e0cd29", "content-length": "147", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24852026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=0
24862026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "79b4066b-7d8e-4ec6-98a0-07025d0b10ef", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24872026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=1
24882026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53489f5-9e78-4066-b6ef-cab493e50ba7", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24892026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=0
24902026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "035ca49c-f50f-4449-a420-51ca47d54a00", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24912026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=1
24922026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66b5b471-73a8-4453-817d-a306a02763bf", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24932026-03-03T18:55:05.227ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=0
24942026-03-03T18:55:05.232ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0293a343-e249-4d0c-b9b2-b21bcfc06396", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24952026-03-03T18:55:05.232ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=1
24962026-03-03T18:55:05.232ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "de3f23f8-e835-4f20-81a3-fd9d2819e9a9", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24972026-03-03T18:55:05.232ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cmpa
24982026-03-03T18:55:05.232ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98e5f4ad-299d-4dab-904f-0571abff1f5a", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
24992026-03-03T18:55:05.232ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cfpa
25002026-03-03T18:55:05.245ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25012026-03-03T18:55:05.245ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25022026-03-03T18:55:05.245ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25032026-03-03T18:55:05.247ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25042026-03-03T18:55:05.276ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052026-03-03T18:55:05.283ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25062026-03-03T18:55:05.283ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25072026-03-03T18:55:05.283ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25082026-03-03T18:55:05.284ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25092026-03-03T18:55:05.286ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9e8c04d-1858-4738-a21f-055140db8dea", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25102026-03-03T18:55:05.286ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cfpa
25112026-03-03T18:55:05.287ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "95e838d4-8b2e-445e-83ba-41b494a0ec41", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25122026-03-03T18:55:05.287ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/0/component/rot/cfpa
25132026-03-03T18:55:05.287ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25142026-03-03T18:55:05.288ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25152026-03-03T18:55:05.288ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25162026-03-03T18:55:05.289ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1057f163-1c46-456c-9447-4baba17eca7e", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25172026-03-03T18:55:05.289ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1
25182026-03-03T18:55:05.290ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25192026-03-03T18:55:05.290ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25202026-03-03T18:55:05.291ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25212026-03-03T18:55:05.291ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
25222026-03-03T18:55:05.291ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
25232026-03-03T18:55:05.291ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
25242026-03-03T18:55:05.291ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
25252026-03-03T18:55:05.292ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
25262026-03-03T18:55:05.294ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d947b78f-1be3-43c2-bd8f-c6d14976d862", "content-length": "723", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25272026-03-03T18:55:05.294ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/host-boot-flash/active-slot
25282026-03-03T18:55:05.294ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2913545-0dc0-4a29-a504-78f3bbdc659a", "content-length": "10", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25292026-03-03T18:55:05.294ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/0
25302026-03-03T18:55:05.294ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "021dfa56-9cb2-4c71-86d2-dcb98e0a1e79", "content-length": "144", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25312026-03-03T18:55:05.295ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/1
25322026-03-03T18:55:05.295ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25332026-03-03T18:55:05.295ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25342026-03-03T18:55:05.296ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25352026-03-03T18:55:05.296ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c88cd1df-4754-4101-97e7-7a42f74254ea", "content-length": "147", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25362026-03-03T18:55:05.296ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=0
25372026-03-03T18:55:05.297ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "07e8e66a-8044-4893-bab2-b41e29b8cf60", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25382026-03-03T18:55:05.297ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=1
25392026-03-03T18:55:05.298ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2eb13fe-6ba3-4c8d-a3aa-c7910c99a544", "content-length": "109", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25402026-03-03T18:55:05.298ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=0
25412026-03-03T18:55:05.298ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }
25422026-03-03T18:55:05.298ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
25432026-03-03T18:55:05.298ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25442026-03-03T18:55:05.298ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25452026-03-03T18:55:05.299ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25462026-03-03T18:55:05.300ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bd20227-0476-45c1-8a37-b5db327be8c0", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25472026-03-03T18:55:05.300ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=1
25482026-03-03T18:55:05.301ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff3f7703-90b4-4001-91b7-a674d015586a", "content-length": "163", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25492026-03-03T18:55:05.301ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=0
25502026-03-03T18:55:05.301ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
25512026-03-03T18:55:05.301ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25522026-03-03T18:55:05.301ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25532026-03-03T18:55:05.303ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25542026-03-03T18:55:05.303ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "62b345a0-7230-46a3-af39-19859b421fa1", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25552026-03-03T18:55:05.304ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=1
25562026-03-03T18:55:05.304ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25572026-03-03T18:55:05.304ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25582026-03-03T18:55:05.304ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25592026-03-03T18:55:05.304ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25602026-03-03T18:55:05.304ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a733c6f-ae67-49e3-a042-7a4b0419d887", "content-length": "166", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25612026-03-03T18:55:05.304ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cmpa
25622026-03-03T18:55:05.305ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25632026-03-03T18:55:05.310ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25642026-03-03T18:55:05.310ZTRACtest_instance_metrics (InternalApi): successful lookup of siloed resource "Vpc" using built-in user
25652026-03-03T18:55:05.310ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25662026-03-03T18:55:05.310ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25672026-03-03T18:55:05.310ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25682026-03-03T18:55:05.311ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2824853c-7f05-4c44-aa84-bf4d276f3f9b", "content-length": "702", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25692026-03-03T18:55:05.311ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cfpa
25702026-03-03T18:55:05.312ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25712026-03-03T18:55:05.312ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25722026-03-03T18:55:05.313ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25732026-03-03T18:55:05.313ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "13f91f41-2808-4d3c-ac77-6aefc15296c9", "content-length": "727", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25742026-03-03T18:55:05.313ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cfpa
25752026-03-03T18:55:05.314ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "28e60f92-549b-4c2a-b9f0-d389b37fc639", "content-length": "729", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25762026-03-03T18:55:05.314ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[::1]:35581 method = GET uri = http://[::1]:35581/sp/sled/1/component/rot/cfpa
25772026-03-03T18:55:05.315ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[::1]:35581 result = Ok(Response { url: "http://[::1]:35581/sp/sled/1/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c8245dc-20f5-4416-9293-8f815b887364", "content-length": "728", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
25782026-03-03T18:55:05.315ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
25792026-03-03T18:55:05.315ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25802026-03-03T18:55:05.315ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
25812026-03-03T18:55:05.315ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25822026-03-03T18:55:05.316ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
25832026-03-03T18:55:05.317ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25842026-03-03T18:55:05.317ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
25852026-03-03T18:55:05.318ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
25862026-03-03T18:55:05.319ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25872026-03-03T18:55:05.321ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
25882026-03-03T18:55:05.321ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet
25892026-03-03T18:55:05.321ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
25902026-03-03T18:55:05.321ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
25912026-03-03T18:55:05.321ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25922026-03-03T18:55:05.321ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
25932026-03-03T18:55:05.323ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25942026-03-03T18:55:05.325ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Fleet result = Ok(())
25952026-03-03T18:55:05.325ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
25962026-03-03T18:55:05.326ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25972026-03-03T18:55:05.326ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
25982026-03-03T18:55:05.327ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
25992026-03-03T18:55:05.327ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26002026-03-03T18:55:05.327ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26012026-03-03T18:55:05.338ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[::1]:37139
26022026-03-03T18:55:05.338ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = http://[::1]:37139 background_task = inventory_collection body = None method = GET uri = http://[::1]:37139/inventory
26032026-03-03T18:55:05.338ZTRACtest_instance_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
26042026-03-03T18:55:05.338ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
26052026-03-03T18:55:05.338ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26062026-03-03T18:55:05.338ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26072026-03-03T18:55:05.339ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26082026-03-03T18:55:05.339ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44658 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
26092026-03-03T18:55:05.340ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44658 req_id = 952ad7a5-7e32-499c-b298-84da7a25ddaf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
26102026-03-03T18:55:05.340ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44658 req_id = 952ad7a5-7e32-499c-b298-84da7a25ddaf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory version = 23.0.0
26112026-03-03T18:55:05.341ZINFOtest_instance_metrics (dropshot): request completed latency_us = 1183 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44658 req_id = 952ad7a5-7e32-499c-b298-84da7a25ddaf response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /inventory
26122026-03-03T18:55:05.341ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = http://[::1]:37139 background_task = inventory_collection result = Ok(Response { url: "http://[::1]:37139/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "952ad7a5-7e32-499c-b298-84da7a25ddaf", "content-length": "20607", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
26132026-03-03T18:55:05.343ZDEBGtest_instance_metrics (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
26142026-03-03T18:55:05.343ZDEBGtest_instance_metrics (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
26152026-03-03T18:55:05.343ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
26162026-03-03T18:55:05.343ZDEBGtest_instance_metrics (CockroachClusterAdminClient): client request body = None method = GET uri = http://[::1]:32222/node/id
26172026-03-03T18:55:05.343ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
26182026-03-03T18:55:05.343ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
26192026-03-03T18:55:05.343ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26202026-03-03T18:55:05.343ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26212026-03-03T18:55:05.344ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26222026-03-03T18:55:05.345ZDEBGtest_instance_metrics (CockroachClusterAdminClient): client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:32222/node/id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:32222, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
26232026-03-03T18:55:05.345ZWARNtest_instance_metrics (CockroachClusterAdminClient): Failed to fetch metrics from CockroachDB node error = Failed to get node ID from [::1]:32222
26242026-03-03T18:55:05.354ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[::1]:10123 zone_id = 509a941e-e250-4e50-988f-821caab8ab38 (omicron_zone)
26252026-03-03T18:55:05.354ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[::1]:10123 uri = http://[::1]:10123/timesync
26262026-03-03T18:55:05.354ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
26272026-03-03T18:55:05.354ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26282026-03-03T18:55:05.354ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26292026-03-03T18:55:05.354ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26302026-03-03T18:55:05.357ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
26312026-03-03T18:55:05.357ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26322026-03-03T18:55:05.357ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26332026-03-03T18:55:05.357ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26342026-03-03T18:55:05.357ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[::1]:10123 result = Err(reqwest::Error { kind: Request, url: "http://[::1]:10123/timesync", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:10123, Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
26352026-03-03T18:55:05.357ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
26362026-03-03T18:55:05.373ZDEBGtest_instance_metrics (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 8ff0765f-f33e-4be2-8577-bdf01f7d3c22 (omicron_zone)
26372026-03-03T18:55:05.373ZDEBGtest_instance_metrics (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[::1]:43761 method = GET uri = http://[::1]:43761/config
26382026-03-03T18:55:05.374ZINFOtest_instance_metrics (http): accepted connection kind = dns local_addr = [::1]:43761 remote_addr = [::1]:34074
26392026-03-03T18:55:05.374ZTRACtest_instance_metrics (http): incoming request kind = dns local_addr = [::1]:43761 method = GET remote_addr = [::1]:34074 req_id = abc7d78f-a7cb-48f8-9d22-b766f8d1e84c uri = /config
26402026-03-03T18:55:05.374ZDEBGtest_instance_metrics (http): determined request API version kind = dns local_addr = [::1]:43761 method = GET remote_addr = [::1]:34074 req_id = abc7d78f-a7cb-48f8-9d22-b766f8d1e84c uri = /config version = 2.0.0
26412026-03-03T18:55:05.375ZINFOtest_instance_metrics (http): request completed kind = dns latency_us = 536 local_addr = [::1]:43761 method = GET remote_addr = [::1]:34074 req_id = abc7d78f-a7cb-48f8-9d22-b766f8d1e84c response_code = 200 uri = /config
26422026-03-03T18:55:05.375ZDEBGtest_instance_metrics (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[::1]:43761 result = Ok(Response { url: "http://[::1]:43761/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "abc7d78f-a7cb-48f8-9d22-b766f8d1e84c", "content-length": "3478", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
26432026-03-03T18:55:05.376ZDEBGtest_instance_metrics (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 8ff0765f-f33e-4be2-8577-bdf01f7d3c22 (omicron_zone)
26442026-03-03T18:55:05.376ZDEBGtest_instance_metrics (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
26452026-03-03T18:55:05.376ZDEBGtest_instance_metrics (BackgroundTasks): finished collection background_task = inventory_collection
26462026-03-03T18:55:05.376ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory
26472026-03-03T18:55:05.376ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_collection resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26482026-03-03T18:55:05.376ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
26492026-03-03T18:55:05.376ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
26502026-03-03T18:55:05.376ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
26512026-03-03T18:55:05.377ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26522026-03-03T18:55:05.377ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26532026-03-03T18:55:05.377ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26542026-03-03T18:55:05.377ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26552026-03-03T18:55:05.378ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26562026-03-03T18:55:05.381ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Inventory result = Ok(())
26572026-03-03T18:55:05.382ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database
26582026-03-03T18:55:05.382ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
26592026-03-03T18:55:05.382ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_collection resource = Database result = Ok(())
26602026-03-03T18:55:05.393ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26612026-03-03T18:55:05.400ZDEBGtest_instance_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26622026-03-03T18:55:05.400ZTRACtest_instance_metrics (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
26632026-03-03T18:55:05.400ZTRACtest_instance_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") }
26642026-03-03T18:55:05.400ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
26652026-03-03T18:55:05.400ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26662026-03-03T18:55:05.400ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26672026-03-03T18:55:05.402ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26682026-03-03T18:55:05.402ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
26692026-03-03T18:55:05.402ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
26702026-03-03T18:55:05.402ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
26712026-03-03T18:55:05.402ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
26722026-03-03T18:55:05.402ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
26732026-03-03T18:55:05.403ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
26742026-03-03T18:55:05.403ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26752026-03-03T18:55:05.403ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26762026-03-03T18:55:05.404ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26772026-03-03T18:55:05.404ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
26782026-03-03T18:55:05.404ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
26792026-03-03T18:55:05.405ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
26802026-03-03T18:55:05.405ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 485.352358ms iteration = 2 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
26812026-03-03T18:55:05.406ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
26822026-03-03T18:55:05.408ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26832026-03-03T18:55:05.408ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26842026-03-03T18:55:05.408ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26852026-03-03T18:55:05.410ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26862026-03-03T18:55:05.420ZDEBGtest_instance_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26872026-03-03T18:55:05.420ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26882026-03-03T18:55:05.420ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26892026-03-03T18:55:05.421ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26902026-03-03T18:55:05.428ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26912026-03-03T18:55:05.428ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26922026-03-03T18:55:05.429ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26932026-03-03T18:55:05.432ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26942026-03-03T18:55:05.432ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26952026-03-03T18:55:05.432ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26962026-03-03T18:55:05.433ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
26972026-03-03T18:55:05.433ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
26982026-03-03T18:55:05.434ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
26992026-03-03T18:55:05.437ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27002026-03-03T18:55:05.437ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27012026-03-03T18:55:05.438ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27022026-03-03T18:55:05.441ZTRACtest_instance_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
27032026-03-03T18:55:05.441ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
27042026-03-03T18:55:05.441ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27052026-03-03T18:55:05.441ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27062026-03-03T18:55:05.441ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27072026-03-03T18:55:05.443ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
27082026-03-03T18:55:05.443ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27092026-03-03T18:55:05.443ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27102026-03-03T18:55:05.444ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27112026-03-03T18:55:05.446ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27122026-03-03T18:55:05.446ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27132026-03-03T18:55:05.446ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27142026-03-03T18:55:05.447ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27152026-03-03T18:55:05.450ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162026-03-03T18:55:05.462ZDEBGtest_instance_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
27172026-03-03T18:55:05.462ZTRACtest_instance_metrics (InternalApi): successful lookup of siloed resource "VpcSubnet" using built-in user
27182026-03-03T18:55:05.462ZTRACtest_instance_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") }
27192026-03-03T18:55:05.462ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-4401-4000-8000-000000000000 resource_type = Project
27202026-03-03T18:55:05.462ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27212026-03-03T18:55:05.462ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27222026-03-03T18:55:05.462ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27232026-03-03T18:55:05.469ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000001 resource_type = Silo
27242026-03-03T18:55:05.469ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27252026-03-03T18:55:05.469ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27262026-03-03T18:55:05.470ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27272026-03-03T18:55:05.473ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27282026-03-03T18:55:05.473ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27292026-03-03T18:55:05.473ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27302026-03-03T18:55:05.475ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27312026-03-03T18:55:05.476ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27322026-03-03T18:55:05.481ZDEBGtest_instance_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
27332026-03-03T18:55:05.481ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27342026-03-03T18:55:05.481ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27352026-03-03T18:55:05.482ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27362026-03-03T18:55:05.496ZDEBGtest_instance_metrics (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 8e3b80d3-cccd-4765-9f01-6173c47f526f, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }], Name("external-dns"): [NetworkInterface { id: f10767e8-56c9-4f62-a39a-8784a6654943, kind: Service { id: ea089734-1711-4991-8e09-9016d0edd1ed }, name: Name("external-dns-ea089734-1711-4991-8e09-9016d0edd1ed"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
27372026-03-03T18:55:05.496ZTRACtest_instance_metrics (InternalApi): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet
27382026-03-03T18:55:05.496ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27392026-03-03T18:55:05.496ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27402026-03-03T18:55:05.496ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27412026-03-03T18:55:05.496ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27422026-03-03T18:55:05.508ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27432026-03-03T18:55:05.511ZDEBGtest_instance_metrics (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Fleet result = Ok(())
27442026-03-03T18:55:05.511ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27452026-03-03T18:55:05.511ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27462026-03-03T18:55:05.511ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27472026-03-03T18:55:05.517ZTRACtest_instance_metrics (InternalApi): fetched allowlist from DB allowed = AllowList { id: 001de000-a110-4000-8000-000000000000, time_created: 2026-03-03T18:36:54.041040Z, time_modified: 2026-03-03T18:55:04.769471Z, allowed_ips: None }
27482026-03-03T18:55:05.517ZDEBGtest_instance_metrics (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
27492026-03-03T18:55:05.517ZDEBGtest_instance_metrics (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f10767e8-56c9-4f62-a39a-8784a6654943, kind: Service { id: ea089734-1711-4991-8e09-9016d0edd1ed }, name: Name("external-dns-ea089734-1711-4991-8e09-9016d0edd1ed"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8e3b80d3-cccd-4765-9f01-6173c47f526f, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: f10767e8-56c9-4f62-a39a-8784a6654943, kind: Service { id: ea089734-1711-4991-8e09-9016d0edd1ed }, name: Name("external-dns-ea089734-1711-4991-8e09-9016d0edd1ed"), ip_config: V6(PrivateIpv6Config { ip: fd77:e9d2:9cd9:1::6, subnet: Ipv6Net { addr: fd77:e9d2:9cd9:1::, width: 64 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 0])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8e3b80d3-cccd-4765-9f01-6173c47f526f, kind: Service { id: 913233fe-92a8-4635-9572-183f495429c4 }, name: Name("nexus-913233fe-92a8-4635-9572-183f495429c4"), ip_config: V4(PrivateIpv4Config { ip: 172.30.2.6, subnet: Ipv4Net { addr: 172.30.2.0, width: 24 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 1])), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
27502026-03-03T18:55:05.517ZDEBGtest_instance_metrics (InternalApi): resolved 3 rules for sleds
27512026-03-03T18:55:05.529ZDEBGtest_instance_metrics (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b6d65341-167c-41df-9b5c-41cded99c229 (sled), time_created: 2026-03-03T18:55:02.932328Z, time_modified: 2026-03-03T18:55:02.932328Z }, time_deleted: None, rcgen: Generation(Generation(1)), rack_id: c19a698f-c6f9-4a17-ae30-20d711b8f7dc, is_scrimlet: true, serial_number: "SimGimlet00", part_number: "i86pc", revision: SqlU32(3), usable_hardware_threads: SqlU32(16), usable_physical_ram: ByteCount(ByteCount(34359738368)), reservoir_size: ByteCount(ByteCount(17179869184)), ip: ::1, port: SqlU16(37139), last_used_address: ::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(41667), cpu_family: AmdMilan }]
27522026-03-03T18:55:05.529ZDEBGtest_instance_metrics (InternalApi): sending firewall rules to sled agents
27532026-03-03T18:55:05.538ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27542026-03-03T18:55:05.538ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27552026-03-03T18:55:05.553ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27562026-03-03T18:55:05.553ZTRACtest_instance_metrics (InternalApi): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
27572026-03-03T18:55:05.553ZTRACtest_instance_metrics (InternalApi): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
27582026-03-03T18:55:05.553ZTRACtest_instance_metrics (InternalApi): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database
27592026-03-03T18:55:05.553ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {} }
27602026-03-03T18:55:05.553ZDEBGtest_instance_metrics (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Database result = Ok(())
27612026-03-03T18:55:05.553ZDEBGtest_instance_metrics (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622026-03-03T18:55:05.553ZDEBGtest_instance_metrics (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
27632026-03-03T18:55:05.553ZDEBGtest_instance_metrics (InternalApi): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:37139/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27642026-03-03T18:55:05.553ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44662 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
27652026-03-03T18:55:05.554ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44662 req_id = fef8ed75-39b0-4f5f-9fc2-fe7f569e376c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27662026-03-03T18:55:05.554ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44662 req_id = fef8ed75-39b0-4f5f-9fc2-fe7f569e376c sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules version = 23.0.0
27672026-03-03T18:55:05.555ZINFOtest_instance_metrics (dropshot): request completed latency_us = 714 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44662 req_id = fef8ed75-39b0-4f5f-9fc2-fe7f569e376c response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27682026-03-03T18:55:05.555ZDEBGtest_instance_metrics (InternalApi): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:37139/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "fef8ed75-39b0-4f5f-9fc2-fe7f569e376c", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
27692026-03-03T18:55:05.555ZINFOtest_instance_metrics (InternalApi): updated firewall rules on 1 sleds
27702026-03-03T18:55:05.555ZINFOtest_instance_metrics (nexus): plumbed initial IP allowlist
27712026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = / versions = all
27722026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /access versions = all
27732026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /assets/{path} versions = all
27742026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /device/auth versions = all
27752026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /device/confirm versions = all
27762026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /device/success versions = all
27772026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /device/token versions = all
27782026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /device/verify versions = all
27792026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/probes versions = all starting from 2026010300.0.0
27802026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/probes versions = all ending with 2026010300.0.0
27812026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /experimental/v1/probes versions = all starting from 2026010500.0.0
27822026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /experimental/v1/probes versions = all ending with 2026010500.0.0
27832026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /experimental/v1/probes/{probe} versions = all
27842026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/probes/{probe} versions = all starting from 2026010300.0.0
27852026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/probes/{probe} versions = all ending with 2026010300.0.0
27862026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/system/support-bundles versions = all
27872026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /experimental/v1/system/support-bundles versions = all
27882026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
27892026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
27902026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
27912026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
27922026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
27932026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
27942026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
27952026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
27962026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /images versions = all
27972026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /login versions = all
27982026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /login/{silo_name}/local versions = all
27992026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
28002026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
28012026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
28022026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /lookup/{path} versions = all
28032026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /projects/{path} versions = all
28042026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /projects-new versions = all
28052026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /scim/v2/Groups versions = all
28062026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /scim/v2/Groups versions = all
28072026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /scim/v2/Groups/{group_id} versions = all
28082026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /scim/v2/Groups/{group_id} versions = all
28092026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PATCH path = /scim/v2/Groups/{group_id} versions = all
28102026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /scim/v2/Groups/{group_id} versions = all
28112026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /scim/v2/Users versions = all
28122026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /scim/v2/Users versions = all
28132026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /scim/v2/Users/{user_id} versions = all
28142026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /scim/v2/Users/{user_id} versions = all
28152026-03-03T18:55:05.581ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PATCH path = /scim/v2/Users/{user_id} versions = all
28162026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /scim/v2/Users/{user_id} versions = all
28172026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /settings/{path} versions = all
28182026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /system/{path} versions = all
28192026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /utilization versions = all
28202026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/affinity-groups versions = all
28212026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/affinity-groups versions = all
28222026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
28232026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
28242026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
28252026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
28262026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
28272026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
28282026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
28292026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/alert-classes versions = all
28302026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/alert-receivers versions = all
28312026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/alert-receivers/{receiver} versions = all
28322026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/alert-receivers/{receiver} versions = all
28332026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/alert-receivers/{receiver}/deliveries versions = all
28342026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/alert-receivers/{receiver}/probe versions = all
28352026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/alert-receivers/{receiver}/subscriptions versions = all
28362026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/alert-receivers/{receiver}/subscriptions/{subscription} versions = all
28372026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/alerts/{alert_id}/resend versions = all
28382026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/anti-affinity-groups versions = all
28392026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/anti-affinity-groups versions = all
28402026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
28412026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
28422026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
28432026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
28442026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
28452026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
28462026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
28472026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/auth-settings versions = all
28482026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/auth-settings versions = all
28492026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/certificates versions = all
28502026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/certificates versions = all
28512026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/certificates/{certificate} versions = all
28522026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/certificates/{certificate} versions = all
28532026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/disks versions = all starting from 2026013001.0.0
28542026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
28552026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/disks versions = all ending with 2025120300.0.0
28562026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks versions = all starting from 2026013100.0.0
28572026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks versions = from 2026013001.0.0 to 2026013100.0.0
28582026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
28592026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks versions = all ending with 2025120300.0.0
28602026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/disks/{disk} versions = all
28612026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/disks/{disk} versions = all starting from 2026013001.0.0
28622026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/disks/{disk} versions = from 2025120300.0.0 to 2026013001.0.0
28632026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/disks/{disk} versions = all ending with 2025120300.0.0
28642026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks/{disk}/bulk-write versions = all
28652026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
28662026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
28672026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/disks/{disk}/finalize versions = all
28682026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/external-subnets versions = all starting from 2026011601.0.0
28692026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/external-subnets versions = all starting from 2026012201.0.0
28702026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/external-subnets versions = from 2026011601.0.0 to 2026012201.0.0
28712026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
28722026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
28732026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
28742026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/external-subnets/{external_subnet}/attach versions = all starting from 2026011601.0.0
28752026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/external-subnets/{external_subnet}/detach versions = all starting from 2026011601.0.0
28762026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/floating-ips versions = all
28772026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips versions = all starting from 2026012200.0.0
28782026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips versions = from 2026011600.0.0 to 2026012200.0.0
28792026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips versions = from 2026010500.0.0 to 2026011600.0.0
28802026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips versions = from 2025122300.0.0 to 2026010500.0.0
28812026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips versions = all ending with 2025122300.0.0
28822026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
28832026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/floating-ips/{floating_ip} versions = all
28842026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
28852026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
28862026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
28872026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/groups versions = all
28882026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/groups/{group_id} versions = all
28892026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/images versions = all
28902026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/images versions = all
28912026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/images/{image} versions = all
28922026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/images/{image} versions = all
28932026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/images/{image}/demote versions = all
28942026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/images/{image}/promote versions = all
28952026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances versions = all
28962026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = all starting from 2026013100.0.0
28972026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = from 2026013001.0.0 to 2026013100.0.0
28982026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = from 2026010800.0.0 to 2026013001.0.0
28992026-03-03T18:55:05.582ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = from 2026010500.0.0 to 2026010800.0.0
29002026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = from 2026010300.0.0 to 2026010500.0.0
29012026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = from 2025122300.0.0 to 2026010300.0.0
29022026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = from 2025120300.0.0 to 2025122300.0.0
29032026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances versions = all ending with 2025120300.0.0
29042026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/instances/{instance} versions = all
29052026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance} versions = all
29062026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/instances/{instance} versions = all starting from 2026010800.0.0
29072026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/instances/{instance} versions = all ending with 2026010800.0.0
29082026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
29092026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
29102026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/disks versions = all starting from 2026013001.0.0
29112026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/disks versions = from 2025120300.0.0 to 2026013001.0.0
29122026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/disks versions = all ending with 2025120300.0.0
29132026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/disks/attach versions = all starting from 2026013001.0.0
29142026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/disks/attach versions = from 2025120300.0.0 to 2026013001.0.0
29152026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/disks/attach versions = all ending with 2025120300.0.0
29162026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/disks/detach versions = all starting from 2026013001.0.0
29172026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/disks/detach versions = from 2025120300.0.0 to 2026013001.0.0
29182026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/disks/detach versions = all ending with 2025120300.0.0
29192026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/external-ips versions = all
29202026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026012300.0.0
29212026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2026012300.0.0
29222026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026010500.0.0
29232026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = from 2025122300.0.0 to 2026010500.0.0
29242026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2025122300.0.0
29252026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/external-subnets versions = all starting from 2026013000.0.0
29262026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/multicast-groups versions = all starting from 2026010800.0.0
29272026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/multicast-groups versions = all ending with 2026010800.0.0
29282026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
29292026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
29302026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
29312026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
29322026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/reboot versions = all
29332026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/serial-console versions = all
29342026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
29352026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
29362026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/start versions = all
29372026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/instances/{instance}/stop versions = all
29382026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/internet-gateway-ip-addresses versions = all
29392026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/internet-gateway-ip-addresses versions = all
29402026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
29412026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/internet-gateway-ip-pools versions = all
29422026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/internet-gateway-ip-pools versions = all
29432026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
29442026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/internet-gateways versions = all
29452026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/internet-gateways versions = all
29462026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
29472026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/internet-gateways/{gateway} versions = all
29482026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ip-pools versions = all starting from 2026020900.0.0
29492026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ip-pools versions = from 2026010100.0.0 to 2026020900.0.0
29502026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ip-pools versions = all ending with 2026010100.0.0
29512026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ip-pools/{pool} versions = all starting from 2026020900.0.0
29522026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ip-pools/{pool} versions = from 2026010100.0.0 to 2026020900.0.0
29532026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ip-pools/{pool} versions = all ending with 2026010100.0.0
29542026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/login/{silo_name}/local versions = all
29552026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/logout versions = all
29562026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/me versions = all
29572026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/me/access-tokens versions = all
29582026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/me/access-tokens/{token_id} versions = all
29592026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/me/groups versions = all
29602026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/me/ssh-keys versions = all
29612026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/me/ssh-keys versions = all
29622026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
29632026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
29642026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/metrics/{metric_name} versions = all
29652026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/multicast-groups versions = all starting from 2026010800.0.0
29662026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/multicast-groups versions = all ending with 2026010800.0.0
29672026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/multicast-groups versions = all ending with 2026010800.0.0
29682026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
29692026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
29702026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
29712026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
29722026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all starting from 2026010800.0.0
29732026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
29742026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
29752026-03-03T18:55:05.583ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/multicast-groups/{multicast_group}/members/{instance} versions = all ending with 2026010800.0.0
29762026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/network-interfaces versions = all starting from 2026010300.0.0
29772026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/network-interfaces versions = all ending with 2026010300.0.0
29782026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/network-interfaces versions = all starting from 2026010300.0.0
29792026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/network-interfaces versions = all ending with 2026010300.0.0
29802026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/network-interfaces/{interface} versions = all
29812026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
29822026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
29832026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
29842026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
29852026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/ping versions = all
29862026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/policy versions = all
29872026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/policy versions = all
29882026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/projects versions = all
29892026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/projects versions = all
29902026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/projects/{project} versions = all
29912026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/projects/{project} versions = all
29922026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/projects/{project} versions = all
29932026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/projects/{project}/policy versions = all
29942026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/projects/{project}/policy versions = all
29952026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/snapshots versions = all
29962026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/snapshots versions = all
29972026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/snapshots/{snapshot} versions = all
29982026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/snapshots/{snapshot} versions = all
29992026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/subnet-pools versions = all starting from 2026020900.0.0
30002026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/subnet-pools versions = from 2026020600.0.0 to 2026020900.0.0
30012026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/subnet-pools/{pool} versions = all starting from 2026020900.0.0
30022026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/audit-log versions = all
30032026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/disks versions = all
30042026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
30052026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
30062026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/racks versions = all
30072026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
30082026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/racks/{rack_id}/membership versions = all starting from 2026012100.0.0
30092026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/abort versions = all starting from 2026020200.0.0
30102026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/add versions = all starting from 2026012100.0.0
30112026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/sleds versions = all
30122026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/hardware/sleds versions = all ending with 2026021900.0.0
30132026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
30142026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
30152026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
30162026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
30172026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
30182026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/switch-port versions = all
30192026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
30202026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
30212026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
30222026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
30232026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
30242026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/switches versions = all
30252026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
30262026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/identity-providers versions = all
30272026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/identity-providers/local/users versions = all
30282026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
30292026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
30302026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/identity-providers/saml versions = all
30312026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
30322026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
30332026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
30342026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
30352026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
30362026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
30372026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
30382026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
30392026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
30402026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
30412026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
30422026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all starting from 2026020900.0.0
30432026-03-03T18:55:05.584ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all ending with 2026020900.0.0
30442026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all starting from 2026020900.0.0
30452026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all ending with 2026020900.0.0
30462026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all starting from 2026020900.0.0
30472026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all ending with 2026020900.0.0
30482026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
30492026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
30502026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
30512026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
30522026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
30532026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
30542026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
30552026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
30562026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all starting from 2026020900.0.0
30572026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all ending with 2026020900.0.0
30582026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools-service versions = all starting from 2026020900.0.0
30592026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools-service versions = all ending with 2026020900.0.0
30602026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools-service/ranges versions = all starting from 2026020900.0.0
30612026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/ip-pools-service/ranges versions = all ending with 2026020900.0.0
30622026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all starting from 2026020900.0.0
30632026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all ending with 2026020900.0.0
30642026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all starting from 2026020900.0.0
30652026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all ending with 2026020900.0.0
30662026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/metrics/{metric_name} versions = all
30672026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/multicast-groups/by-ip/{address} versions = all ending with 2026010800.0.0
30682026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/address-lot versions = all
30692026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/address-lot versions = all
30702026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
30712026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/address-lot/{address_lot} versions = all
30722026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
30732026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/allow-list versions = all
30742026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/networking/allow-list versions = all
30752026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/bfd-disable versions = all
30762026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/bfd-enable versions = all
30772026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bfd-status versions = all
30782026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/networking/bgp versions = all
30792026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
30802026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
30812026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
30822026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
30832026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-announce-set versions = all
30842026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
30852026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
30862026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
30872026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-exported versions = all starting from 2026021301.0.0
30882026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-exported versions = all ending with 2026021301.0.0
30892026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-imported versions = all starting from 2026021301.0.0
30902026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-message-history versions = all
30912026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all ending with 2026021301.0.0
30922026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-status versions = all starting from 2026021301.0.0
30932026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-status versions = from 2025121200.0.0 to 2026021301.0.0
30942026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/bgp-status versions = all ending with 2025121200.0.0
30952026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/inbound-icmp versions = all
30962026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/networking/inbound-icmp versions = all
30972026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/loopback-address versions = all
30982026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/loopback-address versions = all
30992026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
31002026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
31012026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/switch-port-settings versions = all
31022026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/switch-port-settings versions = all starting from 2026021301.0.0
31032026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/networking/switch-port-settings versions = all ending with 2026021301.0.0
31042026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all starting from 2026021301.0.0
31052026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all ending with 2026021301.0.0
31062026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/policy versions = all
31072026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/policy versions = all
31082026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/scim/tokens versions = all
31092026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/scim/tokens versions = all
31102026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/scim/tokens/{token_id} versions = all
31112026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/scim/tokens/{token_id} versions = all
31122026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silo-quotas versions = all
31132026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos versions = all
31142026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/silos versions = all
31152026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/silos/{silo} versions = all
31162026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos/{silo} versions = all
31172026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all starting from 2026010100.0.0
31182026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all ending with 2026010100.0.0
31192026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos/{silo}/policy versions = all
31202026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/silos/{silo}/policy versions = all
31212026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos/{silo}/quotas versions = all
31222026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
31232026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/silos/{silo}/subnet-pools versions = all starting from 2026020600.0.0
31242026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
31252026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
31262026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012800.0.0
31272026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
31282026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
31292026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools versions = from 2026012201.0.0 to 2026012800.0.0
31302026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012201.0.0
31312026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
31322026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026020900.0.0
31332026-03-03T18:55:05.585ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
31342026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
31352026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
31362026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
31372026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
31382026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
31392026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/members versions = all starting from 2026020900.0.0
31402026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026012800.0.0 to 2026020900.0.0
31412026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026011601.0.0 to 2026012800.0.0
31422026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = all starting from 2026020900.0.0
31432026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012800.0.0 to 2026020900.0.0
31442026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012201.0.0 to 2026012800.0.0
31452026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026011601.0.0 to 2026012201.0.0
31462026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = all starting from 2026020900.0.0
31472026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = from 2026011601.0.0 to 2026020900.0.0
31482026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
31492026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
31502026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
31512026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
31522026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
31532026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
31542026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
31552026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
31562026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = all starting from 2026020900.0.0
31572026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = from 2026011601.0.0 to 2026020900.0.0
31582026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/timeseries/query versions = all
31592026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/timeseries/schemas versions = all
31602026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/update/repositories versions = all
31612026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/update/repositories versions = all
31622026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/update/repositories/{system_version} versions = all
31632026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/update/status versions = all
31642026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/system/update/target-release versions = all
31652026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/update/trust-roots versions = all
31662026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/system/update/trust-roots versions = all
31672026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/system/update/trust-roots/{trust_root_id} versions = all
31682026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/update/trust-roots/{trust_root_id} versions = all
31692026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/users versions = all
31702026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/users/{user_id} versions = all
31712026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/users-builtin versions = all
31722026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/users-builtin/{user} versions = all
31732026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/utilization/silos versions = all
31742026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/system/utilization/silos/{silo} versions = all
31752026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/timeseries/query versions = all
31762026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/users versions = all
31772026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/users/{user_id} versions = all
31782026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/users/{user_id}/access-tokens versions = all
31792026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/users/{user_id}/logout versions = all
31802026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/users/{user_id}/sessions versions = all
31812026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/utilization versions = all
31822026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-firewall-rules versions = all
31832026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/vpc-firewall-rules versions = all
31842026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-router-routes versions = all
31852026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/vpc-router-routes versions = all
31862026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
31872026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-router-routes/{route} versions = all
31882026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/vpc-router-routes/{route} versions = all
31892026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-routers versions = all
31902026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/vpc-routers versions = all
31912026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/vpc-routers/{router} versions = all
31922026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-routers/{router} versions = all
31932026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/vpc-routers/{router} versions = all
31942026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-subnets versions = all
31952026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/vpc-subnets versions = all
31962026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
31972026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-subnets/{subnet} versions = all
31982026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
31992026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all starting from 2026010300.0.0
32002026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all ending with 2026010300.0.0
32012026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpcs versions = all
32022026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/vpcs versions = all
32032026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/vpcs/{vpc} versions = all
32042026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/vpcs/{vpc} versions = all
32052026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/vpcs/{vpc} versions = all
32062026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/webhook-receivers versions = all
32072026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = PUT path = /v1/webhook-receivers/{receiver} versions = all
32082026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = GET path = /v1/webhook-secrets versions = all
32092026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = POST path = /v1/webhook-secrets versions = all
32102026-03-03T18:55:05.586ZDEBGtest_instance_metrics (dropshot_external): registered endpoint local_addr = 127.0.0.1:36591 method = DELETE path = /v1/webhook-secrets/{secret_id} versions = all
32112026-03-03T18:55:05.587ZINFOtest_instance_metrics (dropshot_external): listening local_addr = 127.0.0.1:36591
32122026-03-03T18:55:05.587ZDEBGtest_instance_metrics (dropshot_external): successfully registered DTrace USDT probes local_addr = 127.0.0.1:36591
32132026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = / versions = all
32142026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /access versions = all
32152026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /assets/{path} versions = all
32162026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /device/auth versions = all
32172026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /device/confirm versions = all
32182026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /device/success versions = all
32192026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /device/token versions = all
32202026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /device/verify versions = all
32212026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/probes versions = all starting from 2026010300.0.0
32222026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/probes versions = all ending with 2026010300.0.0
32232026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /experimental/v1/probes versions = all starting from 2026010500.0.0
32242026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /experimental/v1/probes versions = all ending with 2026010500.0.0
32252026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /experimental/v1/probes/{probe} versions = all
32262026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/probes/{probe} versions = all starting from 2026010300.0.0
32272026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/probes/{probe} versions = all ending with 2026010300.0.0
32282026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/system/support-bundles versions = all
32292026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /experimental/v1/system/support-bundles versions = all
32302026-03-03T18:55:05.605ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
32312026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
32322026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
32332026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
32342026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
32352026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
32362026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
32372026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
32382026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /images versions = all
32392026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /login versions = all
32402026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /login/{silo_name}/local versions = all
32412026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
32422026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
32432026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
32442026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /lookup/{path} versions = all
32452026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /projects/{path} versions = all
32462026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /projects-new versions = all
32472026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /scim/v2/Groups versions = all
32482026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /scim/v2/Groups versions = all
32492026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /scim/v2/Groups/{group_id} versions = all
32502026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /scim/v2/Groups/{group_id} versions = all
32512026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PATCH path = /scim/v2/Groups/{group_id} versions = all
32522026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /scim/v2/Groups/{group_id} versions = all
32532026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /scim/v2/Users versions = all
32542026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /scim/v2/Users versions = all
32552026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /scim/v2/Users/{user_id} versions = all
32562026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /scim/v2/Users/{user_id} versions = all
32572026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PATCH path = /scim/v2/Users/{user_id} versions = all
32582026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /scim/v2/Users/{user_id} versions = all
32592026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /settings/{path} versions = all
32602026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /system/{path} versions = all
32612026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /utilization versions = all
32622026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/affinity-groups versions = all
32632026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/affinity-groups versions = all
32642026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
32652026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
32662026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
32672026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
32682026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
32692026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
32702026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
32712026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/alert-classes versions = all
32722026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/alert-receivers versions = all
32732026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/alert-receivers/{receiver} versions = all
32742026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/alert-receivers/{receiver} versions = all
32752026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/alert-receivers/{receiver}/deliveries versions = all
32762026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/alert-receivers/{receiver}/probe versions = all
32772026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/alert-receivers/{receiver}/subscriptions versions = all
32782026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/alert-receivers/{receiver}/subscriptions/{subscription} versions = all
32792026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/alerts/{alert_id}/resend versions = all
32802026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/anti-affinity-groups versions = all
32812026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/anti-affinity-groups versions = all
32822026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
32832026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
32842026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
32852026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
32862026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
32872026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
32882026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
32892026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/auth-settings versions = all
32902026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/auth-settings versions = all
32912026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/certificates versions = all
32922026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/certificates versions = all
32932026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/certificates/{certificate} versions = all
32942026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/certificates/{certificate} versions = all
32952026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/disks versions = all starting from 2026013001.0.0
32962026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
32972026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/disks versions = all ending with 2025120300.0.0
32982026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks versions = all starting from 2026013100.0.0
32992026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks versions = from 2026013001.0.0 to 2026013100.0.0
33002026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks versions = from 2025120300.0.0 to 2026013001.0.0
33012026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks versions = all ending with 2025120300.0.0
33022026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/disks/{disk} versions = all
33032026-03-03T18:55:05.606ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/disks/{disk} versions = all starting from 2026013001.0.0
33042026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/disks/{disk} versions = from 2025120300.0.0 to 2026013001.0.0
33052026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/disks/{disk} versions = all ending with 2025120300.0.0
33062026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks/{disk}/bulk-write versions = all
33072026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
33082026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
33092026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/disks/{disk}/finalize versions = all
33102026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/external-subnets versions = all starting from 2026011601.0.0
33112026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/external-subnets versions = all starting from 2026012201.0.0
33122026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/external-subnets versions = from 2026011601.0.0 to 2026012201.0.0
33132026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
33142026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
33152026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/external-subnets/{external_subnet} versions = all starting from 2026011601.0.0
33162026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/external-subnets/{external_subnet}/attach versions = all starting from 2026011601.0.0
33172026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/external-subnets/{external_subnet}/detach versions = all starting from 2026011601.0.0
33182026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/floating-ips versions = all
33192026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips versions = all starting from 2026012200.0.0
33202026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips versions = from 2026011600.0.0 to 2026012200.0.0
33212026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips versions = from 2026010500.0.0 to 2026011600.0.0
33222026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips versions = from 2025122300.0.0 to 2026010500.0.0
33232026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips versions = all ending with 2025122300.0.0
33242026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
33252026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/floating-ips/{floating_ip} versions = all
33262026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
33272026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
33282026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
33292026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/groups versions = all
33302026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/groups/{group_id} versions = all
33312026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/images versions = all
33322026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/images versions = all
33332026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/images/{image} versions = all
33342026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/images/{image} versions = all
33352026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/images/{image}/demote versions = all
33362026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/images/{image}/promote versions = all
33372026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances versions = all
33382026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = all starting from 2026013100.0.0
33392026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = from 2026013001.0.0 to 2026013100.0.0
33402026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = from 2026010800.0.0 to 2026013001.0.0
33412026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = from 2026010500.0.0 to 2026010800.0.0
33422026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = from 2026010300.0.0 to 2026010500.0.0
33432026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = from 2025122300.0.0 to 2026010300.0.0
33442026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = from 2025120300.0.0 to 2025122300.0.0
33452026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances versions = all ending with 2025120300.0.0
33462026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/instances/{instance} versions = all
33472026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance} versions = all
33482026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/instances/{instance} versions = all starting from 2026010800.0.0
33492026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/instances/{instance} versions = all ending with 2026010800.0.0
33502026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
33512026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
33522026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/disks versions = all starting from 2026013001.0.0
33532026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/disks versions = from 2025120300.0.0 to 2026013001.0.0
33542026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/disks versions = all ending with 2025120300.0.0
33552026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/disks/attach versions = all starting from 2026013001.0.0
33562026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/disks/attach versions = from 2025120300.0.0 to 2026013001.0.0
33572026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/disks/attach versions = all ending with 2025120300.0.0
33582026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/disks/detach versions = all starting from 2026013001.0.0
33592026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/disks/detach versions = from 2025120300.0.0 to 2026013001.0.0
33602026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/disks/detach versions = all ending with 2025120300.0.0
33612026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/external-ips versions = all
33622026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026012300.0.0
33632026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2026012300.0.0
33642026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all starting from 2026010500.0.0
33652026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = from 2025122300.0.0 to 2026010500.0.0
33662026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all ending with 2025122300.0.0
33672026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/external-subnets versions = all starting from 2026013000.0.0
33682026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/multicast-groups versions = all starting from 2026010800.0.0
33692026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/multicast-groups versions = all ending with 2026010800.0.0
33702026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
33712026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
33722026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
33732026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/instances/{instance}/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
33742026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/reboot versions = all
33752026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/serial-console versions = all
33762026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
33772026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
33782026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/start versions = all
33792026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/instances/{instance}/stop versions = all
33802026-03-03T18:55:05.607ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/internet-gateway-ip-addresses versions = all
33812026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/internet-gateway-ip-addresses versions = all
33822026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
33832026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/internet-gateway-ip-pools versions = all
33842026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/internet-gateway-ip-pools versions = all
33852026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
33862026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/internet-gateways versions = all
33872026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/internet-gateways versions = all
33882026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
33892026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/internet-gateways/{gateway} versions = all
33902026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ip-pools versions = all starting from 2026020900.0.0
33912026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ip-pools versions = from 2026010100.0.0 to 2026020900.0.0
33922026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ip-pools versions = all ending with 2026010100.0.0
33932026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ip-pools/{pool} versions = all starting from 2026020900.0.0
33942026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ip-pools/{pool} versions = from 2026010100.0.0 to 2026020900.0.0
33952026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ip-pools/{pool} versions = all ending with 2026010100.0.0
33962026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/login/{silo_name}/local versions = all
33972026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/logout versions = all
33982026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/me versions = all
33992026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/me/access-tokens versions = all
34002026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/me/access-tokens/{token_id} versions = all
34012026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/me/groups versions = all
34022026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/me/ssh-keys versions = all
34032026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/me/ssh-keys versions = all
34042026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
34052026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
34062026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/metrics/{metric_name} versions = all
34072026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/multicast-groups versions = all starting from 2026010800.0.0
34082026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/multicast-groups versions = all ending with 2026010800.0.0
34092026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/multicast-groups versions = all ending with 2026010800.0.0
34102026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
34112026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/multicast-groups/{multicast_group} versions = all starting from 2026010800.0.0
34122026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
34132026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/multicast-groups/{multicast_group} versions = all ending with 2026010800.0.0
34142026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all starting from 2026010800.0.0
34152026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
34162026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/multicast-groups/{multicast_group}/members versions = all ending with 2026010800.0.0
34172026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/multicast-groups/{multicast_group}/members/{instance} versions = all ending with 2026010800.0.0
34182026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/network-interfaces versions = all starting from 2026010300.0.0
34192026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/network-interfaces versions = all ending with 2026010300.0.0
34202026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/network-interfaces versions = all starting from 2026010300.0.0
34212026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/network-interfaces versions = all ending with 2026010300.0.0
34222026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/network-interfaces/{interface} versions = all
34232026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
34242026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
34252026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/network-interfaces/{interface} versions = all starting from 2026010300.0.0
34262026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/network-interfaces/{interface} versions = all ending with 2026010300.0.0
34272026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/ping versions = all
34282026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/policy versions = all
34292026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/policy versions = all
34302026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/projects versions = all
34312026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/projects versions = all
34322026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/projects/{project} versions = all
34332026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/projects/{project} versions = all
34342026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/projects/{project} versions = all
34352026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/projects/{project}/policy versions = all
34362026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/projects/{project}/policy versions = all
34372026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/snapshots versions = all
34382026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/snapshots versions = all
34392026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/snapshots/{snapshot} versions = all
34402026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/snapshots/{snapshot} versions = all
34412026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/subnet-pools versions = all starting from 2026020900.0.0
34422026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/subnet-pools versions = from 2026020600.0.0 to 2026020900.0.0
34432026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/subnet-pools/{pool} versions = all starting from 2026020900.0.0
34442026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/audit-log versions = all
34452026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/disks versions = all
34462026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
34472026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
34482026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/racks versions = all
34492026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
34502026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/racks/{rack_id}/membership versions = all starting from 2026012100.0.0
34512026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/abort versions = all starting from 2026020200.0.0
34522026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/hardware/racks/{rack_id}/membership/add versions = all starting from 2026012100.0.0
34532026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/sleds versions = all
34542026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/hardware/sleds versions = all ending with 2026021900.0.0
34552026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
34562026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
34572026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
34582026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
34592026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
34602026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/switch-port versions = all
34612026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
34622026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
34632026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
34642026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
34652026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
34662026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/switches versions = all
34672026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
34682026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/identity-providers versions = all
34692026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/identity-providers/local/users versions = all
34702026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
34712026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
34722026-03-03T18:55:05.608ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/identity-providers/saml versions = all
34732026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
34742026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
34752026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
34762026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools versions = all starting from 2026020900.0.0
34772026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools versions = all ending with 2026020900.0.0
34782026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
34792026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
34802026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
34812026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
34822026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/ip-pools/{pool} versions = all starting from 2026020900.0.0
34832026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/ip-pools/{pool} versions = all ending with 2026020900.0.0
34842026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all starting from 2026020900.0.0
34852026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all ending with 2026020900.0.0
34862026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all starting from 2026020900.0.0
34872026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all ending with 2026020900.0.0
34882026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all starting from 2026020900.0.0
34892026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all ending with 2026020900.0.0
34902026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
34912026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
34922026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all starting from 2026020900.0.0
34932026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all ending with 2026020900.0.0
34942026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
34952026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
34962026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
34972026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all ending with 2026020900.0.0
34982026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all starting from 2026020900.0.0
34992026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all ending with 2026020900.0.0
35002026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools-service versions = all starting from 2026020900.0.0
35012026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools-service versions = all ending with 2026020900.0.0
35022026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools-service/ranges versions = all starting from 2026020900.0.0
35032026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/ip-pools-service/ranges versions = all ending with 2026020900.0.0
35042026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all starting from 2026020900.0.0
35052026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all ending with 2026020900.0.0
35062026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all starting from 2026020900.0.0
35072026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all ending with 2026020900.0.0
35082026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/metrics/{metric_name} versions = all
35092026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/multicast-groups/by-ip/{address} versions = all ending with 2026010800.0.0
35102026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/address-lot versions = all
35112026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/address-lot versions = all
35122026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
35132026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/address-lot/{address_lot} versions = all
35142026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
35152026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/allow-list versions = all
35162026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/networking/allow-list versions = all
35172026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/bfd-disable versions = all
35182026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/bfd-enable versions = all
35192026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bfd-status versions = all
35202026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/networking/bgp versions = all
35212026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
35222026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
35232026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/bgp versions = all starting from 2026021301.0.0
35242026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/bgp versions = all ending with 2026021301.0.0
35252026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-announce-set versions = all
35262026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
35272026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
35282026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
35292026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-exported versions = all starting from 2026021301.0.0
35302026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-exported versions = all ending with 2026021301.0.0
35312026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-imported versions = all starting from 2026021301.0.0
35322026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-message-history versions = all
35332026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all ending with 2026021301.0.0
35342026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-status versions = all starting from 2026021301.0.0
35352026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-status versions = from 2025121200.0.0 to 2026021301.0.0
35362026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/bgp-status versions = all ending with 2025121200.0.0
35372026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/inbound-icmp versions = all
35382026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/networking/inbound-icmp versions = all
35392026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/loopback-address versions = all
35402026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/loopback-address versions = all
35412026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
35422026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
35432026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/switch-port-settings versions = all
35442026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/switch-port-settings versions = all starting from 2026021301.0.0
35452026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/networking/switch-port-settings versions = all ending with 2026021301.0.0
35462026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all starting from 2026021301.0.0
35472026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all ending with 2026021301.0.0
35482026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/policy versions = all
35492026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/policy versions = all
35502026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/scim/tokens versions = all
35512026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/scim/tokens versions = all
35522026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/scim/tokens/{token_id} versions = all
35532026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/scim/tokens/{token_id} versions = all
35542026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silo-quotas versions = all
35552026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos versions = all
35562026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/silos versions = all
35572026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/silos/{silo} versions = all
35582026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos/{silo} versions = all
35592026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all starting from 2026010100.0.0
35602026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all ending with 2026010100.0.0
35612026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos/{silo}/policy versions = all
35622026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/silos/{silo}/policy versions = all
35632026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos/{silo}/quotas versions = all
35642026-03-03T18:55:05.609ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
35652026-03-03T18:55:05.610ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/silos/{silo}/subnet-pools versions = all starting from 2026020600.0.0
35662026-03-03T18:55:05.610ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
35672026-03-03T18:55:05.610ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
35682026-03-03T18:55:05.610ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012800.0.0
35692026-03-03T18:55:05.610ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools versions = all starting from 2026020900.0.0
35702026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools versions = from 2026012800.0.0 to 2026020900.0.0
35712026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools versions = from 2026012201.0.0 to 2026012800.0.0
35722026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools versions = from 2026011601.0.0 to 2026012201.0.0
35732026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
35742026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026020900.0.0
35752026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
35762026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
35772026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
35782026-03-03T18:55:05.621ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/subnet-pools/{pool} versions = all starting from 2026020900.0.0
35792026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026012800.0.0 to 2026020900.0.0
35802026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/subnet-pools/{pool} versions = from 2026011601.0.0 to 2026012800.0.0
35812026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/members versions = all starting from 2026020900.0.0
35822026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026012800.0.0 to 2026020900.0.0
35832026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/members versions = from 2026011601.0.0 to 2026012800.0.0
35842026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = all starting from 2026020900.0.0
35852026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012800.0.0 to 2026020900.0.0
35862026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026012201.0.0 to 2026012800.0.0
35872026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/members/add versions = from 2026011601.0.0 to 2026012201.0.0
35882026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = all starting from 2026020900.0.0
35892026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/members/remove versions = from 2026011601.0.0 to 2026020900.0.0
35902026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
35912026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
35922026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = all starting from 2026020900.0.0
35932026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/subnet-pools/{pool}/silos versions = from 2026011601.0.0 to 2026020900.0.0
35942026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
35952026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
35962026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = all starting from 2026020900.0.0
35972026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/subnet-pools/{pool}/silos/{silo} versions = from 2026011601.0.0 to 2026020900.0.0
35982026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = all starting from 2026020900.0.0
35992026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/subnet-pools/{pool}/utilization versions = from 2026011601.0.0 to 2026020900.0.0
36002026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/timeseries/query versions = all
36012026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/timeseries/schemas versions = all
36022026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/update/repositories versions = all
36032026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/update/repositories versions = all
36042026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/update/repositories/{system_version} versions = all
36052026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/update/status versions = all
36062026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/system/update/target-release versions = all
36072026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/update/trust-roots versions = all
36082026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/system/update/trust-roots versions = all
36092026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/system/update/trust-roots/{trust_root_id} versions = all
36102026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/update/trust-roots/{trust_root_id} versions = all
36112026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/users versions = all
36122026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/users/{user_id} versions = all
36132026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/users-builtin versions = all
36142026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/users-builtin/{user} versions = all
36152026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/utilization/silos versions = all
36162026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/system/utilization/silos/{silo} versions = all
36172026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/timeseries/query versions = all
36182026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/users versions = all
36192026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/users/{user_id} versions = all
36202026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/users/{user_id}/access-tokens versions = all
36212026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/users/{user_id}/logout versions = all
36222026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/users/{user_id}/sessions versions = all
36232026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/utilization versions = all
36242026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-firewall-rules versions = all
36252026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/vpc-firewall-rules versions = all
36262026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-router-routes versions = all
36272026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/vpc-router-routes versions = all
36282026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
36292026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-router-routes/{route} versions = all
36302026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/vpc-router-routes/{route} versions = all
36312026-03-03T18:55:05.622ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-routers versions = all
36322026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/vpc-routers versions = all
36332026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/vpc-routers/{router} versions = all
36342026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-routers/{router} versions = all
36352026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/vpc-routers/{router} versions = all
36362026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-subnets versions = all
36372026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/vpc-subnets versions = all
36382026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
36392026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-subnets/{subnet} versions = all
36402026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
36412026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all starting from 2026010300.0.0
36422026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all ending with 2026010300.0.0
36432026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpcs versions = all
36442026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/vpcs versions = all
36452026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/vpcs/{vpc} versions = all
36462026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/vpcs/{vpc} versions = all
36472026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/vpcs/{vpc} versions = all
36482026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/webhook-receivers versions = all
36492026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = PUT path = /v1/webhook-receivers/{receiver} versions = all
36502026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = GET path = /v1/webhook-secrets versions = all
36512026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = POST path = /v1/webhook-secrets versions = all
36522026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): registered endpoint local_addr = 127.0.0.1:36885 method = DELETE path = /v1/webhook-secrets/{secret_id} versions = all
36532026-03-03T18:55:05.624ZINFOtest_instance_metrics (dropshot_external_techport): listening local_addr = 127.0.0.1:36885
36542026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = 127.0.0.1:36885
36552026-03-03T18:55:05.624ZDEBGtest_instance_metrics (nexus-producer-server): registered DTrace probes
36562026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = 127.0.0.1:37169 method = GET path = /{producer_id} versions = all
36572026-03-03T18:55:05.624ZINFOtest_instance_metrics (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = 127.0.0.1:37169
36582026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot): successfully registered DTrace USDT probes local_addr = 127.0.0.1:37169
36592026-03-03T18:55:05.624ZDEBGtest_instance_metrics (nexus-producer-server): Requested any available port, Dropshot server has been bound to 127.0.0.1:37169
36602026-03-03T18:55:05.624ZDEBGtest_instance_metrics (nexus-producer-server): Nexus IP provided explicitly, will use it addr = 127.0.0.1:33727
36612026-03-03T18:55:05.624ZDEBGtest_instance_metrics (nexus-producer-server): starting producer registration task
36622026-03-03T18:55:05.624ZINFOtest_instance_metrics (nexus-producer-server): starting oximeter metric producer server address = 127.0.0.1:37169 file = oximeter/producer/src/lib.rs:281 interval = 10s producer_id = 913233fe-92a8-4635-9572-183f495429c4
36632026-03-03T18:55:05.624ZDEBGtest_instance_metrics (init_with_steps): Running step start_oximeter
36642026-03-03T18:55:05.624ZDEBGtest_instance_metrics: Starting Oximeter
36652026-03-03T18:55:05.624ZDEBGtest_instance_metrics (oximeter): registered DTrace probes
36662026-03-03T18:55:05.624ZINFOtest_instance_metrics (oximeter): starting oximeter server file = oximeter/collector/src/lib.rs:264
36672026-03-03T18:55:05.624ZDEBGtest_instance_metrics (oximeter): creating ClickHouse client
36682026-03-03T18:55:05.624ZDEBGtest_instance_metrics (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
36692026-03-03T18:55:05.624ZDEBGtest_instance_metrics (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0
36702026-03-03T18:55:05.624ZDEBGtest_instance_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:33727
36712026-03-03T18:55:05.624ZDEBGtest_instance_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:33727/metrics/producers
36722026-03-03T18:55:05.624ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36164
36732026-03-03T18:55:05.624ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36164 req_id = 0769571e-8bcf-4dbd-997f-aa57ee82c73d uri = /metrics/producers
36742026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36164 req_id = 0769571e-8bcf-4dbd-997f-aa57ee82c73d uri = /metrics/producers version = 1.0.0
36752026-03-03T18:55:05.624ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36164 req_id = 0769571e-8bcf-4dbd-997f-aa57ee82c73d resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
36762026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36164 req_id = 0769571e-8bcf-4dbd-997f-aa57ee82c73d roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
36772026-03-03T18:55:05.624ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36164 req_id = 0769571e-8bcf-4dbd-997f-aa57ee82c73d resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
36782026-03-03T18:55:05.678ZINFOtest_instance_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 57034 local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36164 req_id = 0769571e-8bcf-4dbd-997f-aa57ee82c73d response_code = 503 uri = /metrics/producers
36792026-03-03T18:55:05.678ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT MAX(value) AS max_version FROM oximeter.version;
36802026-03-03T18:55:05.678ZDEBGtest_instance_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "0769571e-8bcf-4dbd-997f-aa57ee82c73d", "content-length": "133", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
36812026-03-03T18:55:05.679ZWARNtest_instance_metrics (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 71.371755ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "0769571e-8bcf-4dbd-997f-aa57ee82c73d", "content-length": "133", "date": "Tue, 03 Mar 2026 18:55:05 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "0769571e-8bcf-4dbd-997f-aa57ee82c73d" } file = oximeter/producer/src/lib.rs:377
36822026-03-03T18:55:05.681ZWARNtest_instance_metrics (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:900 id = aff96ec7-4765-46ac-b690-08a123ab22ee
36832026-03-03T18:55:05.681ZDEBGtest_instance_metrics (oximeter-agent): oximeter database does not exist, creating collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
36842026-03-03T18:55:05.681ZINFOtest_instance_metrics (clickhouse-client): reading db version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:800 id = aff96ec7-4765-46ac-b690-08a123ab22ee
36852026-03-03T18:55:05.681ZINFOtest_instance_metrics (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 4fa57051-16b1-4ff9-ae5f-bf6a2bd5cf2b
36862026-03-03T18:55:05.681ZDEBGtest_instance_metrics (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 4fa57051-16b1-4ff9-ae5f-bf6a2bd5cf2b time_started = 2026-03-03 18:55:04.884126 UTC
36872026-03-03T18:55:05.682ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 866.039317ms iteration = 3 status = {"collection_id":"4fa57051-16b1-4ff9-ae5f-bf6a2bd5cf2b","time_done":"2026-03-03 18:55:05.375826 UTC","time_started":"2026-03-03 18:55:04.884126 UTC"}
36882026-03-03T18:55:05.682ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = inventory_loader iteration = 3 reason = Dependency
36892026-03-03T18:55:05.682ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory
36902026-03-03T18:55:05.682ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = inventory_loader resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
36912026-03-03T18:55:05.682ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
36922026-03-03T18:55:05.682ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
36932026-03-03T18:55:05.683ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
36942026-03-03T18:55:05.684ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT MAX(value) AS max_version FROM oximeter.version;
36952026-03-03T18:55:05.685ZWARNtest_instance_metrics (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:900 id = aff96ec7-4765-46ac-b690-08a123ab22ee
36962026-03-03T18:55:05.685ZINFOtest_instance_metrics (clickhouse-client): read oximeter database version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:805 id = aff96ec7-4765-46ac-b690-08a123ab22ee version = 0
36972026-03-03T18:55:05.685ZINFOtest_instance_metrics (clickhouse-client): initializing oximeter schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:810 id = aff96ec7-4765-46ac-b690-08a123ab22ee
36982026-03-03T18:55:05.685ZDEBGtest_instance_metrics (clickhouse-client): initializing ClickHouse database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
36992026-03-03T18:55:05.685ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37002026-03-03T18:55:05.692ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Inventory result = Ok(())
37012026-03-03T18:55:05.692ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
37022026-03-03T18:55:05.692ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
37032026-03-03T18:55:05.693ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
37042026-03-03T18:55:05.697ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = CREATE DATABASE IF NOT EXISTS oximeter
37052026-03-03T18:55:05.699ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database
37062026-03-03T18:55:05.699ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = inventory_loader roles = RoleSet { roles: {} }
37072026-03-03T18:55:05.700ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = inventory_loader resource = Database result = Ok(())
37082026-03-03T18:55:05.701ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\n/* The version table contains metadata about the `oximeter` database */\nCREATE TABLE IF NOT EXISTS oximeter.version\n(\n value UInt64,\n timestamp DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (value, timestamp)
37092026-03-03T18:55:05.715ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\n/* The measurement tables contain all individual samples from each timeseries.\n *\n * Each table stores a single datum type, and otherwise contains nearly the same\n * structure. The primary sorting key is on the timeseries name, key, and then\n * timestamp, so that all timeseries from the same schema are grouped, followed\n * by all samples from the same timeseries.\n *\n * This reflects that one usually looks up the _key_ in one or more field table,\n * and then uses that to index quickly into the measurements tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Bool)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37102026-03-03T18:55:05.725ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37112026-03-03T18:55:05.734ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37122026-03-03T18:55:05.744ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37132026-03-03T18:55:05.753ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt16)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37142026-03-03T18:55:05.765ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = inventory_loader elapsed = 82.781942ms iteration = 3 status = {"Loaded":{"collection_id":"4fa57051-16b1-4ff9-ae5f-bf6a2bd5cf2b","time_loaded":"2026-03-03T18:55:05.682258499Z","time_started":"2026-03-03T18:55:04.884126Z"}}
37152026-03-03T18:55:05.775ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
37162026-03-03T18:55:05.775ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37172026-03-03T18:55:05.775ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37182026-03-03T18:55:05.775ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37192026-03-03T18:55:05.775ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37202026-03-03T18:55:05.776ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37212026-03-03T18:55:05.777ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
37222026-03-03T18:55:05.777ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 84.04\u{b5}s iteration = 3 status = {"error":"task disabled"}
37232026-03-03T18:55:05.777ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = blueprint_planner iteration = 5 reason = Dependency
37242026-03-03T18:55:05.777ZDEBGtest_instance_metrics (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
37252026-03-03T18:55:05.777ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 54.81\u{b5}s iteration = 5 status = "Disabled"
37262026-03-03T18:55:05.777ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 3 reason = Dependency
37272026-03-03T18:55:05.777ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
37282026-03-03T18:55:05.777ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
37292026-03-03T18:55:05.777ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
37302026-03-03T18:55:05.787ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312026-03-03T18:55:05.790ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37322026-03-03T18:55:05.790ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37332026-03-03T18:55:05.790ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37342026-03-03T18:55:05.790ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37352026-03-03T18:55:05.790ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37362026-03-03T18:55:05.791ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37372026-03-03T18:55:05.793ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382026-03-03T18:55:05.799ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37392026-03-03T18:55:05.799ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37402026-03-03T18:55:05.799ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37412026-03-03T18:55:05.799ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37422026-03-03T18:55:05.803ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37432026-03-03T18:55:05.803ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37442026-03-03T18:55:05.804ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37452026-03-03T18:55:05.804ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37462026-03-03T18:55:05.804ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37472026-03-03T18:55:05.805ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37482026-03-03T18:55:05.807ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 39 17 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 9............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:37124 req_id = 5f768ec5-5240-4f4b-8219-1e1f2dee6ba5
37492026-03-03T18:55:05.807ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 14615,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:37124 req_id = 5f768ec5-5240-4f4b-8219-1e1f2dee6ba5
37502026-03-03T18:55:05.807ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
37512026-03-03T18:55:05.807ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
37522026-03-03T18:55:05.807ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:37124 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 5f768ec5-5240-4f4b-8219-1e1f2dee6ba5
37532026-03-03T18:55:05.808ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37542026-03-03T18:55:05.811ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37552026-03-03T18:55:05.811ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37562026-03-03T18:55:05.811ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37572026-03-03T18:55:05.811ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37582026-03-03T18:55:05.811ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37592026-03-03T18:55:05.811ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37602026-03-03T18:55:05.813ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1843, tv_nsec: 77769356 } })
37612026-03-03T18:55:05.813ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
37622026-03-03T18:55:05.814ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632026-03-03T18:55:05.816ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37642026-03-03T18:55:05.816ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37652026-03-03T18:55:05.816ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37662026-03-03T18:55:05.817ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37672026-03-03T18:55:05.817ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
37682026-03-03T18:55:05.820ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: ce 5c 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .\\..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:65318 req_id = c45ba280-6669-440b-b130-480255dd04a7
37692026-03-03T18:55:05.822ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 52828,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:65318 req_id = c45ba280-6669-440b-b130-480255dd04a7
37702026-03-03T18:55:05.822ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
37712026-03-03T18:55:05.822ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:65318 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = c45ba280-6669-440b-b130-480255dd04a7
37722026-03-03T18:55:05.822ZINFOtest_instance_metrics (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous num_already_exist = 0 num_inserted = 0 num_not_in_inventory = 0
37732026-03-03T18:55:05.822ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37742026-03-03T18:55:05.822ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37752026-03-03T18:55:05.822ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37762026-03-03T18:55:05.822ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37772026-03-03T18:55:05.824ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37782026-03-03T18:55:05.844ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
37792026-03-03T18:55:05.845ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37802026-03-03T18:55:05.848ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37812026-03-03T18:55:05.848ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37822026-03-03T18:55:05.848ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37832026-03-03T18:55:05.848ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37842026-03-03T18:55:05.848ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37852026-03-03T18:55:05.848ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37862026-03-03T18:55:05.850ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37872026-03-03T18:55:05.853ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37882026-03-03T18:55:05.853ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37892026-03-03T18:55:05.853ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37902026-03-03T18:55:05.854ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37912026-03-03T18:55:05.857ZINFOtest_instance_metrics (BackgroundTasks): all LocalStorage datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
37922026-03-03T18:55:05.857ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
37932026-03-03T18:55:05.857ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
37942026-03-03T18:55:05.857ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
37952026-03-03T18:55:05.857ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
37962026-03-03T18:55:05.858ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
37972026-03-03T18:55:05.859ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37982026-03-03T18:55:05.862ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
37992026-03-03T18:55:05.862ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet
38002026-03-03T18:55:05.862ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = blueprint_rendezvous resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
38012026-03-03T18:55:05.862ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38022026-03-03T18:55:05.862ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38032026-03-03T18:55:05.863ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38042026-03-03T18:55:05.864ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38052026-03-03T18:55:05.866ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062026-03-03T18:55:05.869ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
38072026-03-03T18:55:05.869ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database
38082026-03-03T18:55:05.869ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38092026-03-03T18:55:05.870ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
38102026-03-03T18:55:05.874ZINFOtest_instance_metrics (BackgroundTasks): all LocalStorageUnencrypted datasets reconciled background_task = blueprint_rendezvous num_already_exist = 0 num_already_tombstoned = 0 num_inserted = 0 num_not_in_inventory = 0 num_tombstoned = 0
38112026-03-03T18:55:05.874ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 98.946569ms iteration = 3 status = {"blueprint_id":"8a08b32b-d851-4895-8ae4-dfff04793931","inventory_collection_id":"4fa57051-16b1-4ff9-ae5f-bf6a2bd5cf2b","stats":{"crucible_dataset":{"num_already_exist":0,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0},"local_storage_unencrypted_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
38122026-03-03T18:55:05.874ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38132026-03-03T18:55:05.876ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b6e7be4-b33a-4887-96a6-0aa3394c2b7b", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:05 GMT"} })
38142026-03-03T18:55:05.876ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
38152026-03-03T18:55:05.876ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38162026-03-03T18:55:05.876ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38172026-03-03T18:55:05.876ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38182026-03-03T18:55:05.878ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
38192026-03-03T18:55:05.878ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
38202026-03-03T18:55:05.878ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38212026-03-03T18:55:05.878ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38222026-03-03T18:55:05.879ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38232026-03-03T18:55:05.932ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f32\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38242026-03-03T18:55:05.939ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
38252026-03-03T18:55:05.939ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
38262026-03-03T18:55:05.939ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38272026-03-03T18:55:05.939ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38282026-03-03T18:55:05.940ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38292026-03-03T18:55:05.941ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_f64\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38302026-03-03T18:55:05.952ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(String)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38312026-03-03T18:55:05.964ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_bytes\n(\n timeseries_name String,\n timeseries_key UInt64,\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Right now we can't unambiguously record a nullable byte array.\n * Arrays cannot be nested in `Nullable()` types, and encoding the array as\n * a string isn't palatable for a few reasons.\n * See: https://github.com/oxidecomputer/omicron/issues/4551 for more\n * details.\n */\n datum Array(UInt8)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38322026-03-03T18:55:05.972ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativei64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Int64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38332026-03-03T18:55:05.984ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
38342026-03-03T18:55:05.984ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
38352026-03-03T18:55:05.984ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38362026-03-03T18:55:05.984ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38372026-03-03T18:55:05.984ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38382026-03-03T18:55:05.987ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
38392026-03-03T18:55:05.987ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38402026-03-03T18:55:05.987ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38412026-03-03T18:55:05.987ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38422026-03-03T18:55:05.993ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativeu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(UInt64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38432026-03-03T18:55:05.996ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
38442026-03-03T18:55:05.998ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
38452026-03-03T18:55:05.998ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
38462026-03-03T18:55:05.998ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
38472026-03-03T18:55:05.998ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
38482026-03-03T18:55:05.998ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
38492026-03-03T18:55:05.998ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
38502026-03-03T18:55:06.004ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
38512026-03-03T18:55:06.005ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 226.537223ms iteration = 3 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
38522026-03-03T18:55:06.005ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float32)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38532026-03-03T18:55:06.015ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_cumulativef64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n datum Nullable(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38542026-03-03T18:55:06.028ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n /*\n * NOTE: Array types cannot be Nullable, see\n * https://clickhouse.com/docs/en/sql-reference/data-types/nullable\n * for more details.\n *\n * This means we need to use empty arrays to indicate a missing value. This\n * is unfortunate, and at this point relies on the fact that an\n * `oximeter::Histogram` cannot have zero bins. If that changes, we'll need\n * to figure out another way to represent missing samples here.\n */\n bins Array(Int8),\n counts Array(UInt64),\n min Int8,\n max Int8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38552026-03-03T18:55:06.040ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu8\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt8),\n counts Array(UInt64),\n min UInt8,\n max UInt8,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38562026-03-03T18:55:06.047ZDEBGtest_instance_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:33727
38572026-03-03T18:55:06.057ZDEBGtest_instance_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:33727/metrics/producers
38582026-03-03T18:55:06.058ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int16),\n counts Array(UInt64),\n min Int16,\n max Int16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38592026-03-03T18:55:06.058ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36166
38602026-03-03T18:55:06.058ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36166 req_id = 20a6bf7d-af60-4edf-96c3-a218789e3c08 uri = /metrics/producers
38612026-03-03T18:55:06.058ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36166 req_id = 20a6bf7d-af60-4edf-96c3-a218789e3c08 uri = /metrics/producers version = 1.0.0
38622026-03-03T18:55:06.058ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36166 req_id = 20a6bf7d-af60-4edf-96c3-a218789e3c08 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
38632026-03-03T18:55:06.059ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36166 req_id = 20a6bf7d-af60-4edf-96c3-a218789e3c08 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
38642026-03-03T18:55:06.059ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36166 req_id = 20a6bf7d-af60-4edf-96c3-a218789e3c08 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
38652026-03-03T18:55:06.063ZINFOtest_instance_metrics (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment latency_us = 4815 local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36166 req_id = 20a6bf7d-af60-4edf-96c3-a218789e3c08 response_code = 503 uri = /metrics/producers
38662026-03-03T18:55:06.063ZDEBGtest_instance_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "20a6bf7d-af60-4edf-96c3-a218789e3c08", "content-length": "133", "date": "Tue, 03 Mar 2026 18:55:06 GMT"} })
38672026-03-03T18:55:06.064ZWARNtest_instance_metrics (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 456.447011ms error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "20a6bf7d-af60-4edf-96c3-a218789e3c08", "content-length": "133", "date": "Tue, 03 Mar 2026 18:55:06 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "20a6bf7d-af60-4edf-96c3-a218789e3c08" } file = oximeter/producer/src/lib.rs:377
38682026-03-03T18:55:06.068ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu16\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt16),\n counts Array(UInt64),\n min UInt16,\n max UInt16,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38692026-03-03T18:55:06.076ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int32),\n counts Array(UInt64),\n min Int32,\n max Int32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38702026-03-03T18:55:06.087ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt32),\n counts Array(UInt64),\n min UInt32,\n max UInt32,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38712026-03-03T18:55:06.096ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogrami64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Int64),\n counts Array(UInt64),\n min Int64,\n max Int64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38722026-03-03T18:55:06.106ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramu64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(UInt64),\n counts Array(UInt64),\n min UInt64,\n max UInt64,\n sum_of_samples Int64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38732026-03-03T18:55:06.117ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf32\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float32),\n counts Array(UInt64),\n min Float32,\n max Float32,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38742026-03-03T18:55:06.131ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.measurements_histogramf64\n(\n timeseries_name String,\n timeseries_key UInt64,\n start_time DateTime64(9, 'UTC'),\n timestamp DateTime64(9, 'UTC'),\n bins Array(Float64),\n counts Array(UInt64),\n min Float64,\n max Float64,\n sum_of_samples Float64,\n squared_mean Float64,\n p50_marker_heights Array(Float64),\n p50_marker_positions Array(UInt64),\n p50_desired_marker_positions Array(Float64),\n p90_marker_heights Array(Float64),\n p90_marker_positions Array(UInt64),\n p90_desired_marker_positions Array(Float64),\n p99_marker_heights Array(Float64),\n p99_marker_positions Array(UInt64),\n p99_desired_marker_positions Array(Float64)\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, timeseries_key, start_time, timestamp)\nTTL toDateTime(timestamp) + INTERVAL 30 DAY
38752026-03-03T18:55:06.142ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\n/* The field tables store named dimensions of each timeseries.\n *\n * As with the measurement tables, there is one field table for each field data\n * type. Fields are deduplicated by using the "replacing merge tree", though\n * this behavior **must not** be relied upon for query correctness.\n *\n * The index for the fields differs from the measurements, however. Rows are\n * sorted by timeseries name, then field name, field value, and finally\n * timeseries key. This reflects the most common pattern for looking them up:\n * by field name and possibly value, within a timeseries. The resulting keys are\n * usually then used to look up measurements.\n *\n * NOTE: We may want to consider a secondary index on these tables, sorting by\n * timeseries name and then key, since it would improve lookups where one\n * already has the key. Realistically though, these tables are quite small and\n * so performance benefits will be low in absolute terms.\n *\n * TTL: We use a materialized column to expire old field table records. This\n * column is generated automatically by the database whenever a new row is\n * inserted. It cannot be inserted directly, nor is it returned in a `SELECT *`\n * query. Since these tables are `ReplacingMergeTree`s, that means the last\n * record will remain during a deduplication, which will have the last\n * timestamp. ClickHouse will then expire old data for us, similar to the\n * measurement tables.\n */\nCREATE TABLE IF NOT EXISTS oximeter.fields_bool\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Bool,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38762026-03-03T18:55:06.151ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38772026-03-03T18:55:06.162ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u8\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt8,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38782026-03-03T18:55:06.173ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38792026-03-03T18:55:06.194ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u16\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt16,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38802026-03-03T18:55:06.204ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38812026-03-03T18:55:06.221ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u32\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt32,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38822026-03-03T18:55:06.225ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_i64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value Int64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38832026-03-03T18:55:06.238ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_u64\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UInt64,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38842026-03-03T18:55:06.253ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_ipaddr\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value IPv6,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38852026-03-03T18:55:06.261ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_string\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value String,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38862026-03-03T18:55:06.274ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\nCREATE TABLE IF NOT EXISTS oximeter.fields_uuid\n(\n timeseries_name String,\n timeseries_key UInt64,\n field_name String,\n field_value UUID,\n last_updated_at DateTime MATERIALIZED now()\n)\nENGINE = ReplacingMergeTree()\nORDER BY (timeseries_name, field_name, field_value, timeseries_key)\nTTL last_updated_at + INTERVAL 30 DAY
38872026-03-03T18:55:06.285ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = \n\n/* The timeseries schema table stores the extracted schema for the samples\n * oximeter collects.\n */\nCREATE TABLE IF NOT EXISTS oximeter.timeseries_schema\n(\n timeseries_name String,\n fields Nested(\n name String,\n type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'IpAddr' = 3,\n 'String' = 4,\n 'Uuid' = 6,\n 'I8' = 7,\n 'U8' = 8,\n 'I16' = 9,\n 'U16' = 10,\n 'I32' = 11,\n 'U32' = 12,\n 'U64' = 13\n ),\n source Enum(\n 'Target' = 1,\n 'Metric' = 2\n )\n ),\n datum_type Enum(\n 'Bool' = 1,\n 'I64' = 2,\n 'F64' = 3,\n 'String' = 4,\n 'Bytes' = 5,\n 'CumulativeI64' = 6,\n 'CumulativeF64' = 7,\n 'HistogramI64' = 8,\n 'HistogramF64' = 9,\n 'I8' = 10,\n 'U8' = 11,\n 'I16' = 12,\n 'U16' = 13,\n 'I32' = 14,\n 'U32' = 15,\n 'U64' = 16,\n 'F32' = 17,\n 'CumulativeU64' = 18,\n 'CumulativeF32' = 19,\n 'HistogramI8' = 20,\n 'HistogramU8' = 21,\n 'HistogramI16' = 22,\n 'HistogramU16' = 23,\n 'HistogramI32' = 24,\n 'HistogramU32' = 25,\n 'HistogramU64' = 26,\n 'HistogramF32' = 27\n ),\n created DateTime64(9, 'UTC')\n)\nENGINE = MergeTree()\nORDER BY (timeseries_name, fields.name)
38882026-03-03T18:55:06.296ZINFOtest_instance_metrics (clickhouse-client): inserting current version collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/db/src/client/mod.rs:831 id = aff96ec7-4765-46ac-b690-08a123ab22ee version = 14
38892026-03-03T18:55:06.296ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = INSERT INTO oximeter.version (*) VALUES (14, now());
38902026-03-03T18:55:06.304ZDEBGtest_instance_metrics (clickhouse-client): registered USDT probes collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = eef4f378-2a8c-4157-afc1-033d2107c285
38912026-03-03T18:55:06.305ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:39963 method = GET path = /info versions = all
38922026-03-03T18:55:06.305ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:39963 method = GET path = /producers versions = all
38932026-03-03T18:55:06.305ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:39963 method = DELETE path = /producers/{producer_id} versions = all
38942026-03-03T18:55:06.305ZDEBGtest_instance_metrics (dropshot): registered endpoint local_addr = [::1]:39963 method = GET path = /producers/{producer_id} versions = all
38952026-03-03T18:55:06.305ZINFOtest_instance_metrics (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [::1]:39963
38962026-03-03T18:55:06.305ZDEBGtest_instance_metrics (dropshot): successfully registered DTrace USDT probes local_addr = [::1]:39963
38972026-03-03T18:55:06.305ZDEBGtest_instance_metrics (oximeter): registered USDT probes
38982026-03-03T18:55:06.305ZDEBGtest_instance_metrics (oximeter): contacting nexus
38992026-03-03T18:55:06.378ZDEBGtest_instance_metrics (oximeter): client request body = Some(Body) method = POST uri = http://127.0.0.1:33727/metrics/collectors
39002026-03-03T18:55:06.379ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36168
39012026-03-03T18:55:06.380ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36168 req_id = 8b9129a3-e983-4fa0-b5b8-78df83c50908 uri = /metrics/collectors
39022026-03-03T18:55:06.380ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36168 req_id = 8b9129a3-e983-4fa0-b5b8-78df83c50908 uri = /metrics/collectors version = 1.0.0
39032026-03-03T18:55:06.380ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36168 req_id = 8b9129a3-e983-4fa0-b5b8-78df83c50908 resource = Database type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
39042026-03-03T18:55:06.380ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36168 req_id = 8b9129a3-e983-4fa0-b5b8-78df83c50908 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
39052026-03-03T18:55:06.380ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36168 req_id = 8b9129a3-e983-4fa0-b5b8-78df83c50908 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors user_builtin_id = 001de000-05e4-4000-8000-000000000002
39062026-03-03T18:55:06.382ZINFOtest_instance_metrics (nexus): registered new oximeter metric collection server address = [::1]:39963 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
39072026-03-03T18:55:06.382ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 3514 local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36168 req_id = 8b9129a3-e983-4fa0-b5b8-78df83c50908 response_code = 204 uri = /metrics/collectors
39082026-03-03T18:55:06.383ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors", status: 204, headers: {"x-request-id": "8b9129a3-e983-4fa0-b5b8-78df83c50908", "date": "Tue, 03 Mar 2026 18:55:06 GMT"} })
39092026-03-03T18:55:06.383ZINFOtest_instance_metrics (oximeter): oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78
39102026-03-03T18:55:06.383ZDEBGtest_instance_metrics (init_with_steps): Running step start_producer_server
39112026-03-03T18:55:06.383ZDEBGtest_instance_metrics: Starting test metric Producer Server
39122026-03-03T18:55:06.383ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/system/ip-pools
39132026-03-03T18:55:06.385ZINFOtest_instance_metrics (oximeter-agent): starting refresh list task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:554
39142026-03-03T18:55:06.402ZINFOtest_instance_metrics (dropshot_external): accepted connection local_addr = 127.0.0.1:36591 remote_addr = 127.0.0.1:46210
39152026-03-03T18:55:06.402ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36170
39162026-03-03T18:55:06.402ZINFOtest_instance_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
39172026-03-03T18:55:06.402ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
39182026-03-03T18:55:06.403ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36170 req_id = 66897538-6f14-4b45-aad7-15fc970b2812 uri = /metrics/producers
39192026-03-03T18:55:06.403ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36170 req_id = 66897538-6f14-4b45-aad7-15fc970b2812 uri = /metrics/producers version = 1.0.0
39202026-03-03T18:55:06.403ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = ec62f4b2-46b6-4798-9129-461db59b83b0 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
39212026-03-03T18:55:06.403ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = ec62f4b2-46b6-4798-9129-461db59b83b0 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
39222026-03-03T18:55:06.403ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36170 req_id = 66897538-6f14-4b45-aad7-15fc970b2812 resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39232026-03-03T18:55:06.403ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36170 req_id = 66897538-6f14-4b45-aad7-15fc970b2812 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39242026-03-03T18:55:06.404ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36170 req_id = 66897538-6f14-4b45-aad7-15fc970b2812 resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39252026-03-03T18:55:06.404ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = ec62f4b2-46b6-4798-9129-461db59b83b0 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
39262026-03-03T18:55:06.404ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = ec62f4b2-46b6-4798-9129-461db59b83b0 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
39272026-03-03T18:55:06.405ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = ec62f4b2-46b6-4798-9129-461db59b83b0 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
39282026-03-03T18:55:06.406ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f uri = /v1/system/ip-pools
39292026-03-03T18:55:06.406ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f uri = /v1/system/ip-pools version = 2026021900.0.0
39302026-03-03T18:55:06.406ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f uri = /v1/system/ip-pools
39312026-03-03T18:55:06.406ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools
39322026-03-03T18:55:06.406ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39332026-03-03T18:55:06.406ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39342026-03-03T18:55:06.406ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39352026-03-03T18:55:06.407ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 4741 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = ec62f4b2-46b6-4798-9129-461db59b83b0 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
39362026-03-03T18:55:06.408ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec62f4b2-46b6-4798-9129-461db59b83b0", "content-length": "29", "date": "Tue, 03 Mar 2026 18:55:06 GMT"} })
39372026-03-03T18:55:06.408ZINFOtest_instance_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
39382026-03-03T18:55:06.409ZINFOtest_instance_metrics (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
39392026-03-03T18:55:06.410ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 6017 local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36170 req_id = 66897538-6f14-4b45-aad7-15fc970b2812 response_code = 201 uri = /metrics/producers
39402026-03-03T18:55:06.410ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39412026-03-03T18:55:06.410ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39422026-03-03T18:55:06.411ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39432026-03-03T18:55:06.412ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
39442026-03-03T18:55:06.412ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
39452026-03-03T18:55:06.412ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39462026-03-03T18:55:06.412ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39472026-03-03T18:55:06.412ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39482026-03-03T18:55:06.414ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39492026-03-03T18:55:06.415ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39502026-03-03T18:55:06.415ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39512026-03-03T18:55:06.415ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39522026-03-03T18:55:06.415ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39532026-03-03T18:55:06.417ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
39542026-03-03T18:55:06.417ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39552026-03-03T18:55:06.417ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39562026-03-03T18:55:06.417ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39572026-03-03T18:55:06.419ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
39582026-03-03T18:55:06.419ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
39592026-03-03T18:55:06.419ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39602026-03-03T18:55:06.419ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39612026-03-03T18:55:06.420ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39622026-03-03T18:55:06.421ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
39632026-03-03T18:55:06.421ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
39642026-03-03T18:55:06.421ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
39652026-03-03T18:55:06.421ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
39662026-03-03T18:55:06.422ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39672026-03-03T18:55:06.424ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
39682026-03-03T18:55:06.424ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f uri = /v1/system/ip-pools
39692026-03-03T18:55:06.424ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39702026-03-03T18:55:06.424ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39712026-03-03T18:55:06.424ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39722026-03-03T18:55:06.424ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39732026-03-03T18:55:06.425ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39742026-03-03T18:55:06.435ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39752026-03-03T18:55:06.437ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39762026-03-03T18:55:06.438ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39772026-03-03T18:55:06.438ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39782026-03-03T18:55:06.438ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39792026-03-03T18:55:06.488ZDEBGtest_instance_metrics (producer-registration-task): will register with Nexus at 127.0.0.1:33727
39802026-03-03T18:55:06.496ZDEBGtest_instance_metrics (producer-registration-task): client request body = Some(Body) method = POST uri = http://127.0.0.1:33727/metrics/producers
39812026-03-03T18:55:06.497ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39822026-03-03T18:55:06.497ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39832026-03-03T18:55:06.497ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39842026-03-03T18:55:06.497ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39852026-03-03T18:55:06.497ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39862026-03-03T18:55:06.498ZINFOtest_instance_metrics (dropshot_internal): accepted connection local_addr = 127.0.0.1:33727 remote_addr = 127.0.0.1:36172
39872026-03-03T18:55:06.498ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36172 req_id = ff21de29-4eab-46b7-8eac-069081b08e1c uri = /metrics/producers
39882026-03-03T18:55:06.498ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36172 req_id = ff21de29-4eab-46b7-8eac-069081b08e1c uri = /metrics/producers version = 1.0.0
39892026-03-03T18:55:06.499ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36172 req_id = ff21de29-4eab-46b7-8eac-069081b08e1c resource = Database type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39902026-03-03T18:55:06.499ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36172 req_id = ff21de29-4eab-46b7-8eac-069081b08e1c roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39912026-03-03T18:55:06.503ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36172 req_id = ff21de29-4eab-46b7-8eac-069081b08e1c resource = Database result = Ok(()) type = user_builtin uri = /metrics/producers user_builtin_id = 001de000-05e4-4000-8000-000000000002
39922026-03-03T18:55:06.503ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39932026-03-03T18:55:06.504ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39942026-03-03T18:55:06.504ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39952026-03-03T18:55:06.504ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39962026-03-03T18:55:06.504ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
39972026-03-03T18:55:06.530ZINFOtest_instance_metrics (nexus): assigned collector to new producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 producer_id = 913233fe-92a8-4635-9572-183f495429c4
39982026-03-03T18:55:06.530ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 31594 local_addr = 127.0.0.1:33727 method = POST remote_addr = 127.0.0.1:36172 req_id = ff21de29-4eab-46b7-8eac-069081b08e1c response_code = 201 uri = /metrics/producers
39992026-03-03T18:55:06.530ZDEBGtest_instance_metrics (producer-registration-task): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ff21de29-4eab-46b7-8eac-069081b08e1c", "content-length": "41", "date": "Tue, 03 Mar 2026 18:55:06 GMT"} })
40002026-03-03T18:55:06.530ZDEBGtest_instance_metrics (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
40012026-03-03T18:55:06.583ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40022026-03-03T18:55:06.583ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40032026-03-03T18:55:06.583ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40042026-03-03T18:55:06.583ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40052026-03-03T18:55:06.584ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40062026-03-03T18:55:06.586ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40072026-03-03T18:55:06.588ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40082026-03-03T18:55:06.588ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40092026-03-03T18:55:06.588ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40102026-03-03T18:55:06.588ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
40112026-03-03T18:55:06.617ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 211337 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = c076f151-33a6-43d8-af55-e65f9331677f response_code = 201 uri = /v1/system/ip-pools
40122026-03-03T18:55:06.617ZINFOtest_instance_metrics (external client test context): client received response status = 201
40132026-03-03T18:55:06.617ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/system/ip-pools/default-v4/ranges/add
40142026-03-03T18:55:06.617ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 uri = /v1/system/ip-pools/default-v4/ranges/add
40152026-03-03T18:55:06.617ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 uri = /v1/system/ip-pools/default-v4/ranges/add version = 2026021900.0.0
40162026-03-03T18:55:06.618ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 uri = /v1/system/ip-pools/default-v4/ranges/add
40172026-03-03T18:55:06.618ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v4/ranges/add
40182026-03-03T18:55:06.618ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40192026-03-03T18:55:06.618ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40202026-03-03T18:55:06.618ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40212026-03-03T18:55:06.620ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40222026-03-03T18:55:06.620ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40232026-03-03T18:55:06.620ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40242026-03-03T18:55:06.622ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
40252026-03-03T18:55:06.622ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40262026-03-03T18:55:06.622ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40272026-03-03T18:55:06.622ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40282026-03-03T18:55:06.622ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40292026-03-03T18:55:06.623ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40302026-03-03T18:55:06.623ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40312026-03-03T18:55:06.623ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40322026-03-03T18:55:06.624ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40332026-03-03T18:55:06.625ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40342026-03-03T18:55:06.627ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
40352026-03-03T18:55:06.627ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40362026-03-03T18:55:06.627ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40372026-03-03T18:55:06.627ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40382026-03-03T18:55:06.629ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
40392026-03-03T18:55:06.630ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
40402026-03-03T18:55:06.630ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40412026-03-03T18:55:06.630ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40422026-03-03T18:55:06.630ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40432026-03-03T18:55:06.631ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
40442026-03-03T18:55:06.631ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
40452026-03-03T18:55:06.631ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
40462026-03-03T18:55:06.632ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
40472026-03-03T18:55:06.633ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40482026-03-03T18:55:06.634ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
40492026-03-03T18:55:06.634ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 uri = /v1/system/ip-pools/default-v4/ranges/add
40502026-03-03T18:55:06.634ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40512026-03-03T18:55:06.634ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40522026-03-03T18:55:06.634ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40532026-03-03T18:55:06.635ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40542026-03-03T18:55:06.635ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40552026-03-03T18:55:06.637ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40562026-03-03T18:55:06.638ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40572026-03-03T18:55:06.638ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40582026-03-03T18:55:06.638ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40592026-03-03T18:55:06.638ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40602026-03-03T18:55:06.691ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40612026-03-03T18:55:06.691ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40622026-03-03T18:55:06.692ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40632026-03-03T18:55:06.695ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = IpPool { parent: Fleet, key: d7cde2f8-3ebd-4438-8bcc-81f8813dea2a, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40642026-03-03T18:55:06.695ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40652026-03-03T18:55:06.695ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40662026-03-03T18:55:06.695ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40672026-03-03T18:55:06.695ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40682026-03-03T18:55:06.696ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40692026-03-03T18:55:06.699ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = IpPool { parent: Fleet, key: d7cde2f8-3ebd-4438-8bcc-81f8813dea2a, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40702026-03-03T18:55:06.699ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40712026-03-03T18:55:06.699ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40722026-03-03T18:55:06.700ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40732026-03-03T18:55:06.730ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40742026-03-03T18:55:06.730ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40752026-03-03T18:55:06.731ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40762026-03-03T18:55:06.732ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = IpPool { parent: Fleet, key: d7cde2f8-3ebd-4438-8bcc-81f8813dea2a, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40772026-03-03T18:55:06.732ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40782026-03-03T18:55:06.732ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40792026-03-03T18:55:06.732ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40802026-03-03T18:55:06.732ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40812026-03-03T18:55:06.735ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40822026-03-03T18:55:06.739ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = IpPool { parent: Fleet, key: d7cde2f8-3ebd-4438-8bcc-81f8813dea2a, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40832026-03-03T18:55:06.750ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40842026-03-03T18:55:06.750ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40852026-03-03T18:55:06.750ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40862026-03-03T18:55:06.750ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40872026-03-03T18:55:06.750ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40882026-03-03T18:55:06.756ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40892026-03-03T18:55:06.756ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40902026-03-03T18:55:06.756ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40912026-03-03T18:55:06.756ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40922026-03-03T18:55:06.756ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/ranges/add
40932026-03-03T18:55:06.784ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 166815 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 73e157b7-53bc-4810-826a-5887ef8fb1b2 response_code = 201 uri = /v1/system/ip-pools/default-v4/ranges/add
40942026-03-03T18:55:06.785ZINFOtest_instance_metrics (external client test context): client received response status = 201
40952026-03-03T18:55:06.785ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/system/ip-pools/default-v4/silos
40962026-03-03T18:55:06.785ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce uri = /v1/system/ip-pools/default-v4/silos
40972026-03-03T18:55:06.785ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce uri = /v1/system/ip-pools/default-v4/silos version = 2026021900.0.0
40982026-03-03T18:55:06.786ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce uri = /v1/system/ip-pools/default-v4/silos
40992026-03-03T18:55:06.786ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v4/silos
41002026-03-03T18:55:06.786ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41012026-03-03T18:55:06.786ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41022026-03-03T18:55:06.786ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41032026-03-03T18:55:06.793ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41042026-03-03T18:55:06.793ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41052026-03-03T18:55:06.793ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41062026-03-03T18:55:06.797ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
41072026-03-03T18:55:06.797ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
41082026-03-03T18:55:06.797ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41092026-03-03T18:55:06.797ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41102026-03-03T18:55:06.798ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41112026-03-03T18:55:06.799ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41122026-03-03T18:55:06.799ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41132026-03-03T18:55:06.799ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41142026-03-03T18:55:06.800ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41152026-03-03T18:55:06.801ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41162026-03-03T18:55:06.803ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
41172026-03-03T18:55:06.803ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41182026-03-03T18:55:06.803ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41192026-03-03T18:55:06.804ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41202026-03-03T18:55:06.805ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
41212026-03-03T18:55:06.806ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
41222026-03-03T18:55:06.806ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41232026-03-03T18:55:06.806ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41242026-03-03T18:55:06.806ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41252026-03-03T18:55:06.807ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
41262026-03-03T18:55:06.807ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41272026-03-03T18:55:06.807ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41282026-03-03T18:55:06.807ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41292026-03-03T18:55:06.808ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41302026-03-03T18:55:06.810ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
41312026-03-03T18:55:06.810ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce uri = /v1/system/ip-pools/default-v4/silos
41322026-03-03T18:55:06.810ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41332026-03-03T18:55:06.810ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41342026-03-03T18:55:06.811ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41352026-03-03T18:55:06.811ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41362026-03-03T18:55:06.811ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41372026-03-03T18:55:06.812ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41382026-03-03T18:55:06.814ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41392026-03-03T18:55:06.814ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41402026-03-03T18:55:06.814ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41412026-03-03T18:55:06.814ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41422026-03-03T18:55:06.816ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41432026-03-03T18:55:06.816ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41442026-03-03T18:55:06.816ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41452026-03-03T18:55:06.818ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = IpPool { parent: Fleet, key: d7cde2f8-3ebd-4438-8bcc-81f8813dea2a, lookup_type: ByName("default-v4") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41462026-03-03T18:55:06.818ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41472026-03-03T18:55:06.818ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41482026-03-03T18:55:06.818ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41492026-03-03T18:55:06.818ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41502026-03-03T18:55:06.820ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41512026-03-03T18:55:06.823ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = IpPool { parent: Fleet, key: d7cde2f8-3ebd-4438-8bcc-81f8813dea2a, lookup_type: ByName("default-v4") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41522026-03-03T18:55:06.823ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41532026-03-03T18:55:06.823ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41542026-03-03T18:55:06.823ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41552026-03-03T18:55:06.824ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41562026-03-03T18:55:06.824ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41572026-03-03T18:55:06.825ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41582026-03-03T18:55:06.826ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41592026-03-03T18:55:06.826ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41602026-03-03T18:55:06.826ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41612026-03-03T18:55:06.826ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41622026-03-03T18:55:06.826ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41632026-03-03T18:55:06.828ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41642026-03-03T18:55:06.828ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41652026-03-03T18:55:06.828ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41662026-03-03T18:55:06.829ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41672026-03-03T18:55:06.830ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41682026-03-03T18:55:06.832ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41692026-03-03T18:55:06.832ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41702026-03-03T18:55:06.832ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41712026-03-03T18:55:06.832ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41722026-03-03T18:55:06.832ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41732026-03-03T18:55:06.832ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41742026-03-03T18:55:06.834ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41752026-03-03T18:55:06.837ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41762026-03-03T18:55:06.837ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41772026-03-03T18:55:06.837ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41782026-03-03T18:55:06.837ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41792026-03-03T18:55:06.875ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41802026-03-03T18:55:06.875ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41812026-03-03T18:55:06.875ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41822026-03-03T18:55:06.875ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41832026-03-03T18:55:06.876ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41842026-03-03T18:55:06.878ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41852026-03-03T18:55:06.880ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41862026-03-03T18:55:06.880ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41872026-03-03T18:55:06.880ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41882026-03-03T18:55:06.880ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v4/silos
41892026-03-03T18:55:06.883ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 97331 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 376d7e01-841a-45ce-ba42-1b08a88b1dce response_code = 201 uri = /v1/system/ip-pools/default-v4/silos
41902026-03-03T18:55:06.883ZINFOtest_instance_metrics (external client test context): client received response status = 201
41912026-03-03T18:55:06.883ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/system/ip-pools
41922026-03-03T18:55:06.883ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f uri = /v1/system/ip-pools
41932026-03-03T18:55:06.883ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f uri = /v1/system/ip-pools version = 2026021900.0.0
41942026-03-03T18:55:06.883ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f uri = /v1/system/ip-pools
41952026-03-03T18:55:06.883ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools
41962026-03-03T18:55:06.884ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
41972026-03-03T18:55:06.884ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
41982026-03-03T18:55:06.884ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
41992026-03-03T18:55:06.886ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42002026-03-03T18:55:06.886ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42012026-03-03T18:55:06.886ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42022026-03-03T18:55:06.887ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
42032026-03-03T18:55:06.887ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
42042026-03-03T18:55:06.887ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42052026-03-03T18:55:06.887ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42062026-03-03T18:55:06.889ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42072026-03-03T18:55:06.889ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42082026-03-03T18:55:06.889ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42092026-03-03T18:55:06.889ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42102026-03-03T18:55:06.889ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42112026-03-03T18:55:06.891ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42122026-03-03T18:55:06.893ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
42132026-03-03T18:55:06.893ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42142026-03-03T18:55:06.893ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42152026-03-03T18:55:06.893ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42162026-03-03T18:55:06.894ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
42172026-03-03T18:55:06.894ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
42182026-03-03T18:55:06.894ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42192026-03-03T18:55:06.894ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42202026-03-03T18:55:06.895ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42212026-03-03T18:55:06.896ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42222026-03-03T18:55:06.896ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42232026-03-03T18:55:06.896ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42242026-03-03T18:55:06.896ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42252026-03-03T18:55:06.897ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42262026-03-03T18:55:06.899ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
42272026-03-03T18:55:06.899ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f uri = /v1/system/ip-pools
42282026-03-03T18:55:06.899ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42292026-03-03T18:55:06.899ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42302026-03-03T18:55:06.899ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42312026-03-03T18:55:06.899ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42322026-03-03T18:55:06.900ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42332026-03-03T18:55:06.901ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42342026-03-03T18:55:06.913ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42352026-03-03T18:55:06.913ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42362026-03-03T18:55:06.913ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42372026-03-03T18:55:06.913ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42382026-03-03T18:55:06.972ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42392026-03-03T18:55:06.975ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42402026-03-03T18:55:06.975ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42412026-03-03T18:55:06.975ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42422026-03-03T18:55:06.975ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42432026-03-03T18:55:06.975ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42442026-03-03T18:55:06.977ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42452026-03-03T18:55:06.977ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42462026-03-03T18:55:06.977ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42472026-03-03T18:55:06.985ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42482026-03-03T18:55:07.041ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42492026-03-03T18:55:07.041ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42502026-03-03T18:55:07.041ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42512026-03-03T18:55:07.041ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42522026-03-03T18:55:07.041ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42532026-03-03T18:55:07.043ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42542026-03-03T18:55:07.044ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42552026-03-03T18:55:07.044ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42562026-03-03T18:55:07.044ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42572026-03-03T18:55:07.045ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools
42582026-03-03T18:55:07.049ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 165583 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0b034529-9a87-403a-a695-1668ad95521f response_code = 201 uri = /v1/system/ip-pools
42592026-03-03T18:55:07.049ZINFOtest_instance_metrics (external client test context): client received response status = 201
42602026-03-03T18:55:07.049ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/system/ip-pools/default-v6/ranges/add
42612026-03-03T18:55:07.049ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 uri = /v1/system/ip-pools/default-v6/ranges/add
42622026-03-03T18:55:07.050ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 uri = /v1/system/ip-pools/default-v6/ranges/add version = 2026021900.0.0
42632026-03-03T18:55:07.050ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 uri = /v1/system/ip-pools/default-v6/ranges/add
42642026-03-03T18:55:07.050ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v6/ranges/add
42652026-03-03T18:55:07.050ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42662026-03-03T18:55:07.050ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42672026-03-03T18:55:07.050ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42682026-03-03T18:55:07.052ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42692026-03-03T18:55:07.052ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42702026-03-03T18:55:07.052ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42712026-03-03T18:55:07.053ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
42722026-03-03T18:55:07.053ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
42732026-03-03T18:55:07.053ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42742026-03-03T18:55:07.053ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42752026-03-03T18:55:07.054ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42762026-03-03T18:55:07.055ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42772026-03-03T18:55:07.055ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42782026-03-03T18:55:07.055ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42792026-03-03T18:55:07.055ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42802026-03-03T18:55:07.056ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42812026-03-03T18:55:07.059ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
42822026-03-03T18:55:07.059ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42832026-03-03T18:55:07.059ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42842026-03-03T18:55:07.059ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42852026-03-03T18:55:07.060ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
42862026-03-03T18:55:07.060ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
42872026-03-03T18:55:07.060ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42882026-03-03T18:55:07.060ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42892026-03-03T18:55:07.060ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42902026-03-03T18:55:07.062ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
42912026-03-03T18:55:07.062ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
42922026-03-03T18:55:07.062ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
42932026-03-03T18:55:07.062ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
42942026-03-03T18:55:07.063ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42952026-03-03T18:55:07.065ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
42962026-03-03T18:55:07.065ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 uri = /v1/system/ip-pools/default-v6/ranges/add
42972026-03-03T18:55:07.065ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
42982026-03-03T18:55:07.065ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
42992026-03-03T18:55:07.065ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43002026-03-03T18:55:07.065ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43012026-03-03T18:55:07.065ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43022026-03-03T18:55:07.067ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43032026-03-03T18:55:07.068ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43042026-03-03T18:55:07.068ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43052026-03-03T18:55:07.068ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43062026-03-03T18:55:07.069ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43072026-03-03T18:55:07.070ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43082026-03-03T18:55:07.070ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43092026-03-03T18:55:07.070ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43102026-03-03T18:55:07.072ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = IpPool { parent: Fleet, key: 61c242fc-2ac3-4abc-8850-b3bc4b84fe5c, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43112026-03-03T18:55:07.072ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43122026-03-03T18:55:07.072ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43132026-03-03T18:55:07.072ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43142026-03-03T18:55:07.072ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43152026-03-03T18:55:07.074ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43162026-03-03T18:55:07.076ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = IpPool { parent: Fleet, key: 61c242fc-2ac3-4abc-8850-b3bc4b84fe5c, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43172026-03-03T18:55:07.076ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43182026-03-03T18:55:07.076ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43192026-03-03T18:55:07.077ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43202026-03-03T18:55:07.078ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43212026-03-03T18:55:07.078ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43222026-03-03T18:55:07.078ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43232026-03-03T18:55:07.079ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = IpPool { parent: Fleet, key: 61c242fc-2ac3-4abc-8850-b3bc4b84fe5c, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43242026-03-03T18:55:07.079ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43252026-03-03T18:55:07.079ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43262026-03-03T18:55:07.079ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43272026-03-03T18:55:07.079ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43282026-03-03T18:55:07.081ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43292026-03-03T18:55:07.082ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = IpPool { parent: Fleet, key: 61c242fc-2ac3-4abc-8850-b3bc4b84fe5c, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43302026-03-03T18:55:07.087ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43312026-03-03T18:55:07.087ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43322026-03-03T18:55:07.087ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43332026-03-03T18:55:07.087ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43342026-03-03T18:55:07.088ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43352026-03-03T18:55:07.097ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43362026-03-03T18:55:07.099ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43372026-03-03T18:55:07.100ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43382026-03-03T18:55:07.100ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43392026-03-03T18:55:07.100ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/ranges/add
43402026-03-03T18:55:07.102ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 52285 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 01d8659d-3774-44de-9651-4964765774d1 response_code = 201 uri = /v1/system/ip-pools/default-v6/ranges/add
43412026-03-03T18:55:07.102ZINFOtest_instance_metrics (external client test context): client received response status = 201
43422026-03-03T18:55:07.102ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/system/ip-pools/default-v6/silos
43432026-03-03T18:55:07.102ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf uri = /v1/system/ip-pools/default-v6/silos
43442026-03-03T18:55:07.103ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf uri = /v1/system/ip-pools/default-v6/silos version = 2026021900.0.0
43452026-03-03T18:55:07.103ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf uri = /v1/system/ip-pools/default-v6/silos
43462026-03-03T18:55:07.103ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/ip-pools/default-v6/silos
43472026-03-03T18:55:07.103ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43482026-03-03T18:55:07.103ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43492026-03-03T18:55:07.103ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43502026-03-03T18:55:07.105ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43512026-03-03T18:55:07.105ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43522026-03-03T18:55:07.105ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43532026-03-03T18:55:07.106ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
43542026-03-03T18:55:07.106ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
43552026-03-03T18:55:07.106ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43562026-03-03T18:55:07.106ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43572026-03-03T18:55:07.107ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43582026-03-03T18:55:07.108ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43592026-03-03T18:55:07.108ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43602026-03-03T18:55:07.108ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43612026-03-03T18:55:07.108ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43622026-03-03T18:55:07.109ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43632026-03-03T18:55:07.111ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
43642026-03-03T18:55:07.111ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43652026-03-03T18:55:07.111ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43662026-03-03T18:55:07.112ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43672026-03-03T18:55:07.113ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
43682026-03-03T18:55:07.113ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
43692026-03-03T18:55:07.113ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43702026-03-03T18:55:07.113ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43712026-03-03T18:55:07.113ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43722026-03-03T18:55:07.114ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
43732026-03-03T18:55:07.114ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
43742026-03-03T18:55:07.114ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
43752026-03-03T18:55:07.114ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
43762026-03-03T18:55:07.115ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43772026-03-03T18:55:07.117ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
43782026-03-03T18:55:07.117ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf uri = /v1/system/ip-pools/default-v6/silos
43792026-03-03T18:55:07.117ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43802026-03-03T18:55:07.117ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43812026-03-03T18:55:07.117ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43822026-03-03T18:55:07.117ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43832026-03-03T18:55:07.118ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43842026-03-03T18:55:07.119ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43852026-03-03T18:55:07.121ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43862026-03-03T18:55:07.121ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43872026-03-03T18:55:07.121ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43882026-03-03T18:55:07.121ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43892026-03-03T18:55:07.122ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43902026-03-03T18:55:07.122ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43912026-03-03T18:55:07.123ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43922026-03-03T18:55:07.124ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = IpPool { parent: Fleet, key: 61c242fc-2ac3-4abc-8850-b3bc4b84fe5c, lookup_type: ByName("default-v6") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43932026-03-03T18:55:07.124ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43942026-03-03T18:55:07.124ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43952026-03-03T18:55:07.124ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43962026-03-03T18:55:07.124ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43972026-03-03T18:55:07.126ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43982026-03-03T18:55:07.129ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = IpPool { parent: Fleet, key: 61c242fc-2ac3-4abc-8850-b3bc4b84fe5c, lookup_type: ByName("default-v6") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
43992026-03-03T18:55:07.129ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44002026-03-03T18:55:07.129ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44012026-03-03T18:55:07.129ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44022026-03-03T18:55:07.133ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44032026-03-03T18:55:07.134ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44042026-03-03T18:55:07.134ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44052026-03-03T18:55:07.134ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44062026-03-03T18:55:07.134ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44072026-03-03T18:55:07.134ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44082026-03-03T18:55:07.134ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44092026-03-03T18:55:07.134ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44102026-03-03T18:55:07.138ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44112026-03-03T18:55:07.138ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44122026-03-03T18:55:07.138ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44132026-03-03T18:55:07.139ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44142026-03-03T18:55:07.141ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44152026-03-03T18:55:07.142ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44162026-03-03T18:55:07.142ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = IpPoolList silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44172026-03-03T18:55:07.142ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44182026-03-03T18:55:07.142ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44192026-03-03T18:55:07.142ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44202026-03-03T18:55:07.143ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44212026-03-03T18:55:07.145ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44222026-03-03T18:55:07.147ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = IpPoolList result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44232026-03-03T18:55:07.147ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44242026-03-03T18:55:07.147ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44252026-03-03T18:55:07.147ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44262026-03-03T18:55:07.150ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44272026-03-03T18:55:07.150ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44282026-03-03T18:55:07.150ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44292026-03-03T18:55:07.150ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44302026-03-03T18:55:07.150ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44312026-03-03T18:55:07.152ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44322026-03-03T18:55:07.154ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44332026-03-03T18:55:07.154ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44342026-03-03T18:55:07.154ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44352026-03-03T18:55:07.156ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/ip-pools/default-v6/silos
44362026-03-03T18:55:07.158ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 55853 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = de2d87fc-f49c-49fd-bd9c-f726bbcda1cf response_code = 201 uri = /v1/system/ip-pools/default-v6/silos
44372026-03-03T18:55:07.159ZINFOtest_instance_metrics (external client test context): client received response status = 201
44382026-03-03T18:55:07.159ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/projects
44392026-03-03T18:55:07.159ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 uri = /v1/projects
44402026-03-03T18:55:07.159ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 uri = /v1/projects version = 2026021900.0.0
44412026-03-03T18:55:07.159ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 uri = /v1/projects
44422026-03-03T18:55:07.159ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/projects
44432026-03-03T18:55:07.159ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44442026-03-03T18:55:07.159ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44452026-03-03T18:55:07.160ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44462026-03-03T18:55:07.161ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44472026-03-03T18:55:07.161ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44482026-03-03T18:55:07.161ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44492026-03-03T18:55:07.162ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
44502026-03-03T18:55:07.163ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
44512026-03-03T18:55:07.163ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44522026-03-03T18:55:07.163ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44532026-03-03T18:55:07.163ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44542026-03-03T18:55:07.164ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44552026-03-03T18:55:07.164ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44562026-03-03T18:55:07.164ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44572026-03-03T18:55:07.164ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44582026-03-03T18:55:07.165ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44592026-03-03T18:55:07.167ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
44602026-03-03T18:55:07.167ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44612026-03-03T18:55:07.167ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44622026-03-03T18:55:07.168ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44632026-03-03T18:55:07.169ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
44642026-03-03T18:55:07.170ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
44652026-03-03T18:55:07.170ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44662026-03-03T18:55:07.170ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44672026-03-03T18:55:07.170ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44682026-03-03T18:55:07.170ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
44692026-03-03T18:55:07.170ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
44702026-03-03T18:55:07.170ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
44712026-03-03T18:55:07.170ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
44722026-03-03T18:55:07.171ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44732026-03-03T18:55:07.173ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
44742026-03-03T18:55:07.173ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 uri = /v1/projects
44752026-03-03T18:55:07.173ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44762026-03-03T18:55:07.173ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44772026-03-03T18:55:07.173ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44782026-03-03T18:55:07.173ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44792026-03-03T18:55:07.173ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44802026-03-03T18:55:07.175ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44812026-03-03T18:55:07.176ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44822026-03-03T18:55:07.176ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44832026-03-03T18:55:07.176ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44842026-03-03T18:55:07.177ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44852026-03-03T18:55:07.178ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44862026-03-03T18:55:07.178ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44872026-03-03T18:55:07.178ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44882026-03-03T18:55:07.178ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44892026-03-03T18:55:07.179ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44902026-03-03T18:55:07.180ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44912026-03-03T18:55:07.180ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44922026-03-03T18:55:07.181ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44932026-03-03T18:55:07.181ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44942026-03-03T18:55:07.182ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44952026-03-03T18:55:07.184ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
44962026-03-03T18:55:07.184ZINFOtest_instance_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
44972026-03-03T18:55:07.184ZINFOtest_instance_metrics (SagaExecutor): preparing saga saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create
44982026-03-03T18:55:07.184ZINFOtest_instance_metrics (SEC): saga create dag = {"end_node":21,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[16,17,null],[17,18,null],[2,3,null],[18,19,null],[20,0,null],[19,21,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSubnetRouteId","name":"subnet_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet_route","label":"VpcCreateSubnetRoute","name":"route"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null},"project_create":{"description":"a pier","name":"springfield-squidport"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"project-create","start_node":20} saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
44992026-03-03T18:55:07.185ZINFOtest_instance_metrics (SecStore): creating saga saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create
45002026-03-03T18:55:07.211ZINFOtest_instance_metrics (SagaExecutor): starting saga saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create
45012026-03-03T18:55:07.211ZINFOtest_instance_metrics (SEC): saga start saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
45022026-03-03T18:55:07.211ZDEBGtest_instance_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45032026-03-03T18:55:07.211ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45042026-03-03T18:55:07.216ZDEBGtest_instance_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45052026-03-03T18:55:07.216ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 20 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45062026-03-03T18:55:07.218ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45072026-03-03T18:55:07.218ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45082026-03-03T18:55:07.219ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45092026-03-03T18:55:07.221ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45102026-03-03T18:55:07.221ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45112026-03-03T18:55:07.221ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45122026-03-03T18:55:07.221ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45132026-03-03T18:55:07.222ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45142026-03-03T18:55:07.222ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45152026-03-03T18:55:07.222ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45162026-03-03T18:55:07.222ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45172026-03-03T18:55:07.224ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45182026-03-03T18:55:07.226ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45192026-03-03T18:55:07.226ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45202026-03-03T18:55:07.226ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45212026-03-03T18:55:07.226ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = ProjectCreateRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45222026-03-03T18:55:07.232ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45232026-03-03T18:55:07.233ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "name": String("springfield-squidport"), "time_created": String("2026-03-03T18:55:07.219954Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.219954Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]) node_id = 0 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45242026-03-03T18:55:07.233ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45252026-03-03T18:55:07.235ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45262026-03-03T18:55:07.235ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45272026-03-03T18:55:07.235ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdba:1e8e:1370::/48"), "name": String("default")}}) node_id = 1 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45282026-03-03T18:55:07.237ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45292026-03-03T18:55:07.237ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45302026-03-03T18:55:07.238ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45312026-03-03T18:55:07.239ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45322026-03-03T18:55:07.239ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45332026-03-03T18:55:07.239ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45342026-03-03T18:55:07.243ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45352026-03-03T18:55:07.243ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")) node_id = 3 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45362026-03-03T18:55:07.246ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45372026-03-03T18:55:07.246ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45382026-03-03T18:55:07.247ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45392026-03-03T18:55:07.248ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("bb01fc78-45a4-4eed-8256-9ed2a649a798")) node_id = 4 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45402026-03-03T18:55:07.248ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45412026-03-03T18:55:07.248ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45422026-03-03T18:55:07.250ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45432026-03-03T18:55:07.251ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("fc09cf8f-6cdb-4797-9b3d-0606d944fed3")) node_id = 5 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45442026-03-03T18:55:07.251ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45452026-03-03T18:55:07.251ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45462026-03-03T18:55:07.252ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45472026-03-03T18:55:07.252ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("17a3a7f5-e675-4d60-b2d8-2f3235b40870")) node_id = 6 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45482026-03-03T18:55:07.254ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45492026-03-03T18:55:07.254ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45502026-03-03T18:55:07.255ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45512026-03-03T18:55:07.255ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("bbba3ce2-776f-43c4-befe-386630506b07")) node_id = 7 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45522026-03-03T18:55:07.260ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45532026-03-03T18:55:07.260ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45542026-03-03T18:55:07.261ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45552026-03-03T18:55:07.262ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("e879c791-c017-4ff2-8fbd-628089f569be")) node_id = 8 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45562026-03-03T18:55:07.263ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45572026-03-03T18:55:07.263ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45582026-03-03T18:55:07.265ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45592026-03-03T18:55:07.265ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7")) node_id = 9 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45602026-03-03T18:55:07.266ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45612026-03-03T18:55:07.267ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45622026-03-03T18:55:07.267ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45632026-03-03T18:55:07.267ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45642026-03-03T18:55:07.267ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45652026-03-03T18:55:07.267ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45662026-03-03T18:55:07.268ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45672026-03-03T18:55:07.270ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45682026-03-03T18:55:07.270ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45692026-03-03T18:55:07.270ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45702026-03-03T18:55:07.270ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45712026-03-03T18:55:07.272ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45722026-03-03T18:55:07.272ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45732026-03-03T18:55:07.272ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45742026-03-03T18:55:07.272ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45752026-03-03T18:55:07.274ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45762026-03-03T18:55:07.277ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45772026-03-03T18:55:07.278ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45782026-03-03T18:55:07.278ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45792026-03-03T18:55:07.278ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateVpc silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45802026-03-03T18:55:07.282ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
45812026-03-03T18:55:07.282ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "name": String("default"), "time_created": String("2026-03-03T18:55:07.267857Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.267857Z")}, "ipv6_prefix": String("fdba:1e8e:1370::/48"), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "subnet_gen": Number(1), "system_router_id": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "vni": Number(13437014)}]) node_id = 10 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45822026-03-03T18:55:07.283ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
45832026-03-03T18:55:07.284ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
45842026-03-03T18:55:07.285ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45852026-03-03T18:55:07.285ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45862026-03-03T18:55:07.285ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45872026-03-03T18:55:07.285ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45882026-03-03T18:55:07.285ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45892026-03-03T18:55:07.287ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45902026-03-03T18:55:07.288ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45912026-03-03T18:55:07.288ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45922026-03-03T18:55:07.288ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45932026-03-03T18:55:07.289ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45942026-03-03T18:55:07.290ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45952026-03-03T18:55:07.290ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45962026-03-03T18:55:07.290ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45972026-03-03T18:55:07.291ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45982026-03-03T18:55:07.294ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
45992026-03-03T18:55:07.294ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46002026-03-03T18:55:07.294ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46012026-03-03T18:55:07.295ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateRouter silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46022026-03-03T18:55:07.306ZTRACtest_instance_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
46032026-03-03T18:55:07.306ZTRACtest_instance_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
46042026-03-03T18:55:07.326ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
46052026-03-03T18:55:07.327ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "lookup_type": Object {"ById": String("bb01fc78-45a4-4eed-8256-9ed2a649a798")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 11 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46062026-03-03T18:55:07.328ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
46072026-03-03T18:55:07.329ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46082026-03-03T18:55:07.330ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46092026-03-03T18:55:07.330ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46102026-03-03T18:55:07.330ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46112026-03-03T18:55:07.330ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46122026-03-03T18:55:07.330ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46132026-03-03T18:55:07.332ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46142026-03-03T18:55:07.334ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46152026-03-03T18:55:07.334ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46162026-03-03T18:55:07.334ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46172026-03-03T18:55:07.334ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46182026-03-03T18:55:07.334ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46192026-03-03T18:55:07.334ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46202026-03-03T18:55:07.334ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46212026-03-03T18:55:07.339ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46222026-03-03T18:55:07.344ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46232026-03-03T18:55:07.344ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46242026-03-03T18:55:07.344ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46252026-03-03T18:55:07.344ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV4Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46262026-03-03T18:55:07.347ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
46272026-03-03T18:55:07.347ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46282026-03-03T18:55:07.353ZDEBGtest_instance_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
46292026-03-03T18:55:07.353ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46302026-03-03T18:55:07.355ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46312026-03-03T18:55:07.355ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46322026-03-03T18:55:07.355ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46332026-03-03T18:55:07.355ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46342026-03-03T18:55:07.356ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46352026-03-03T18:55:07.358ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46362026-03-03T18:55:07.358ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46372026-03-03T18:55:07.358ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46382026-03-03T18:55:07.358ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46392026-03-03T18:55:07.360ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46402026-03-03T18:55:07.360ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46412026-03-03T18:55:07.360ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46422026-03-03T18:55:07.360ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46432026-03-03T18:55:07.361ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46442026-03-03T18:55:07.366ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46452026-03-03T18:55:07.366ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46462026-03-03T18:55:07.366ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46472026-03-03T18:55:07.366ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateV6Route silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46482026-03-03T18:55:07.369ZDEBGtest_instance_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
46492026-03-03T18:55:07.369ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46502026-03-03T18:55:07.370ZDEBGtest_instance_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
46512026-03-03T18:55:07.370ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46522026-03-03T18:55:07.372ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46532026-03-03T18:55:07.372ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46542026-03-03T18:55:07.372ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46552026-03-03T18:55:07.372ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46562026-03-03T18:55:07.372ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46572026-03-03T18:55:07.374ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46582026-03-03T18:55:07.374ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46592026-03-03T18:55:07.374ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46602026-03-03T18:55:07.374ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46612026-03-03T18:55:07.376ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46622026-03-03T18:55:07.376ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46632026-03-03T18:55:07.376ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46642026-03-03T18:55:07.376ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46652026-03-03T18:55:07.379ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46662026-03-03T18:55:07.383ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46672026-03-03T18:55:07.385ZDEBGtest_instance_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
46682026-03-03T18:55:07.385ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("e879c791-c017-4ff2-8fbd-628089f569be"), "lookup_type": Object {"ById": String("e879c791-c017-4ff2-8fbd-628089f569be")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("e879c791-c017-4ff2-8fbd-628089f569be"), "name": String("default"), "time_created": String("2026-03-03T18:55:07.372258Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.372258Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdba:1e8e:1370::/64"), "rcgen": Number(1), "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}]) node_id = 14 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46692026-03-03T18:55:07.387ZDEBGtest_instance_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
46702026-03-03T18:55:07.387ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46712026-03-03T18:55:07.388ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46722026-03-03T18:55:07.388ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46732026-03-03T18:55:07.388ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46742026-03-03T18:55:07.389ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46752026-03-03T18:55:07.389ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46762026-03-03T18:55:07.391ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46772026-03-03T18:55:07.391ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46782026-03-03T18:55:07.391ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46792026-03-03T18:55:07.391ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46802026-03-03T18:55:07.393ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46812026-03-03T18:55:07.393ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46822026-03-03T18:55:07.393ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46832026-03-03T18:55:07.393ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46842026-03-03T18:55:07.395ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46852026-03-03T18:55:07.399ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46862026-03-03T18:55:07.399ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46872026-03-03T18:55:07.399ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46882026-03-03T18:55:07.399ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateSubnetRoute silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46892026-03-03T18:55:07.402ZDEBGtest_instance_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
46902026-03-03T18:55:07.402ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("bbba3ce2-776f-43c4-befe-386630506b07"), "lookup_type": Object {"ById": String("e879c791-c017-4ff2-8fbd-628089f569be")}, "parent": Object {"key": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "lookup_type": Object {"ById": String("bb01fc78-45a4-4eed-8256-9ed2a649a798")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}) node_id = 15 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46912026-03-03T18:55:07.404ZDEBGtest_instance_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
46922026-03-03T18:55:07.404ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
46932026-03-03T18:55:07.406ZDEBGtest_instance_metrics (nexus): default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 7817a02f-b37d-43c0-a74d-28cbf725b9a9, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2026-03-03T18:55:07.406036Z, time_modified: 2026-03-03T18:55:07.406036Z, time_deleted: None }, vpc_id: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 7c6b1bd2-bc6a-4f71-8216-9e01d6d84819, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2026-03-03T18:55:07.406059Z, time_modified: 2026-03-03T18:55:07.406059Z, time_deleted: None }, vpc_id: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: e39640f6-deec-49f6-8b33-064cc9b72578, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2026-03-03T18:55:07.406069Z, time_modified: 2026-03-03T18:55:07.406069Z, time_deleted: None }, vpc_id: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp(None))]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
46942026-03-03T18:55:07.407ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46952026-03-03T18:55:07.407ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46962026-03-03T18:55:07.407ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46972026-03-03T18:55:07.407ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46982026-03-03T18:55:07.407ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
46992026-03-03T18:55:07.408ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47002026-03-03T18:55:07.408ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47012026-03-03T18:55:07.408ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47022026-03-03T18:55:07.408ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47032026-03-03T18:55:07.410ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47042026-03-03T18:55:07.410ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47052026-03-03T18:55:07.411ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47062026-03-03T18:55:07.411ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47072026-03-03T18:55:07.411ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47082026-03-03T18:55:07.415ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47092026-03-03T18:55:07.415ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47102026-03-03T18:55:07.415ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47112026-03-03T18:55:07.415ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcUpdateFirewall silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47122026-03-03T18:55:07.452ZDEBGtest_instance_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
47132026-03-03T18:55:07.452ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("7817a02f-b37d-43c0-a74d-28cbf725b9a9"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:55:07.406036Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406036Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("7c6b1bd2-bc6a-4f71-8216-9e01d6d84819"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:55:07.406059Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406059Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("e39640f6-deec-49f6-8b33-064cc9b72578"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:55:07.406069Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406069Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}]) node_id = 16 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
47142026-03-03T18:55:07.454ZDEBGtest_instance_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
47152026-03-03T18:55:07.454ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
47162026-03-03T18:55:07.456ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47172026-03-03T18:55:07.456ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47182026-03-03T18:55:07.456ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47192026-03-03T18:55:07.456ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47202026-03-03T18:55:07.457ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47212026-03-03T18:55:07.462ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47222026-03-03T18:55:07.462ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47232026-03-03T18:55:07.462ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47242026-03-03T18:55:07.463ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47252026-03-03T18:55:07.464ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47262026-03-03T18:55:07.464ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47272026-03-03T18:55:07.464ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47282026-03-03T18:55:07.465ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47292026-03-03T18:55:07.467ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47302026-03-03T18:55:07.470ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47312026-03-03T18:55:07.471ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47322026-03-03T18:55:07.471ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47332026-03-03T18:55:07.471ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47342026-03-03T18:55:07.472ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47352026-03-03T18:55:07.472ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47362026-03-03T18:55:07.473ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47372026-03-03T18:55:07.474ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47382026-03-03T18:55:07.474ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47392026-03-03T18:55:07.475ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47402026-03-03T18:55:07.501ZWARNtest_instance_metrics (SagaExecutor): Default ip pool lookup failed: Invalid Request: Multiple default unicast IP pools exist with different IP versions. Please specify ip_version (v4 or v6) or provide an explicit pool.. Default gateway has no ip pool association authenticated = true saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcCreateGateway silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47412026-03-03T18:55:07.501ZDEBGtest_instance_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
47422026-03-03T18:55:07.501ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"key": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7"), "lookup_type": Object {"ById": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}) node_id = 17 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
47432026-03-03T18:55:07.503ZDEBGtest_instance_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
47442026-03-03T18:55:07.504ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
47452026-03-03T18:55:07.504ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47462026-03-03T18:55:07.504ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47472026-03-03T18:55:07.505ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47482026-03-03T18:55:07.506ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47492026-03-03T18:55:07.506ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47502026-03-03T18:55:07.506ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47512026-03-03T18:55:07.508ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47522026-03-03T18:55:07.508ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47532026-03-03T18:55:07.508ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47542026-03-03T18:55:07.509ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47552026-03-03T18:55:07.509ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47562026-03-03T18:55:07.509ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47572026-03-03T18:55:07.509ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47582026-03-03T18:55:07.509ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47592026-03-03T18:55:07.511ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47602026-03-03T18:55:07.511ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47612026-03-03T18:55:07.511ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47622026-03-03T18:55:07.511ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47632026-03-03T18:55:07.512ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47642026-03-03T18:55:07.513ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47652026-03-03T18:55:07.513ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47662026-03-03T18:55:07.513ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47672026-03-03T18:55:07.514ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47682026-03-03T18:55:07.519ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47692026-03-03T18:55:07.519ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47702026-03-03T18:55:07.519ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47712026-03-03T18:55:07.519ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47722026-03-03T18:55:07.519ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47732026-03-03T18:55:07.519ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47742026-03-03T18:55:07.520ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47752026-03-03T18:55:07.520ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47762026-03-03T18:55:07.520ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47772026-03-03T18:55:07.521ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47782026-03-03T18:55:07.522ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47792026-03-03T18:55:07.522ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47802026-03-03T18:55:07.522ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47812026-03-03T18:55:07.522ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47822026-03-03T18:55:07.524ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47832026-03-03T18:55:07.528ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47842026-03-03T18:55:07.528ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47852026-03-03T18:55:07.528ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47862026-03-03T18:55:07.528ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47872026-03-03T18:55:07.531ZDEBGtest_instance_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
47882026-03-03T18:55:07.531ZDEBGtest_instance_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = []
47892026-03-03T18:55:07.531ZDEBGtest_instance_metrics (nexus): resolved 0 rules for sleds
47902026-03-03T18:55:07.614ZDEBGtest_instance_metrics (nexus): resolved sleds for vpc default vpc_to_sled = []
47912026-03-03T18:55:07.614ZDEBGtest_instance_metrics (nexus): sending firewall rules to sled agents
47922026-03-03T18:55:07.614ZINFOtest_instance_metrics (nexus): updated firewall rules on 0 sleds
47932026-03-03T18:55:07.614ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47942026-03-03T18:55:07.614ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47952026-03-03T18:55:07.614ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_node = VpcNotifySleds silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
47962026-03-03T18:55:07.616ZDEBGtest_instance_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
47972026-03-03T18:55:07.616ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
47982026-03-03T18:55:07.618ZDEBGtest_instance_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
47992026-03-03T18:55:07.618ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
48002026-03-03T18:55:07.619ZDEBGtest_instance_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
48012026-03-03T18:55:07.619ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
48022026-03-03T18:55:07.620ZDEBGtest_instance_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
48032026-03-03T18:55:07.620ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
48042026-03-03T18:55:07.621ZDEBGtest_instance_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
48052026-03-03T18:55:07.621ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
48062026-03-03T18:55:07.622ZINFOtest_instance_metrics (SEC): update for saga cached state new_state = Done saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc sec_id = 913233fe-92a8-4635-9572-183f495429c4
48072026-03-03T18:55:07.622ZINFOtest_instance_metrics (SecStore): updating state new_state = done saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
48082026-03-03T18:55:07.647ZINFOtest_instance_metrics (SEC): saga finished result = success saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
48092026-03-03T18:55:07.647ZINFOtest_instance_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc
48102026-03-03T18:55:07.648ZINFOtest_instance_metrics (SagaExecutor): saga finished saga_id = a10cbd4f-7179-4103-a6da-37f8d118a9dc saga_name = project-create saga_result = SagaResult { saga_id: a10cbd4f-7179-4103-a6da-37f8d118a9dc, saga_log: SagaLog { saga_id: a10cbd4f-7179-4103-a6da-37f8d118a9dc, unwinding: false, events: [N020 started, N020 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N021 started, N021 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "name": String("springfield-squidport"), "time_created": String("2026-03-03T18:55:07.219954Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.219954Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdba:1e8e:1370::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")), 4: Succeeded(String("bb01fc78-45a4-4eed-8256-9ed2a649a798")), 5: Succeeded(String("fc09cf8f-6cdb-4797-9b3d-0606d944fed3")), 6: Succeeded(String("17a3a7f5-e675-4d60-b2d8-2f3235b40870")), 7: Succeeded(String("bbba3ce2-776f-43c4-befe-386630506b07")), 8: Succeeded(String("e879c791-c017-4ff2-8fbd-628089f569be")), 9: Succeeded(String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7")), 10: Succeeded(Array [Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "name": String("default"), "time_created": String("2026-03-03T18:55:07.267857Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.267857Z")}, "ipv6_prefix": String("fdba:1e8e:1370::/48"), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "subnet_gen": Number(1), "system_router_id": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "vni": Number(13437014)}]), 11: Succeeded(Object {"key": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "lookup_type": Object {"ById": String("bb01fc78-45a4-4eed-8256-9ed2a649a798")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Array [Object {"key": String("e879c791-c017-4ff2-8fbd-628089f569be"), "lookup_type": Object {"ById": String("e879c791-c017-4ff2-8fbd-628089f569be")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("e879c791-c017-4ff2-8fbd-628089f569be"), "name": String("default"), "time_created": String("2026-03-03T18:55:07.372258Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.372258Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdba:1e8e:1370::/64"), "rcgen": Number(1), "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}]), 15: Succeeded(Object {"key": String("bbba3ce2-776f-43c4-befe-386630506b07"), "lookup_type": Object {"ById": String("e879c791-c017-4ff2-8fbd-628089f569be")}, "parent": Object {"key": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "lookup_type": Object {"ById": String("bb01fc78-45a4-4eed-8256-9ed2a649a798")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}), 16: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("7817a02f-b37d-43c0-a74d-28cbf725b9a9"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:55:07.406036Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406036Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("7c6b1bd2-bc6a-4f71-8216-9e01d6d84819"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:55:07.406059Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406059Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("e39640f6-deec-49f6-8b33-064cc9b72578"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:55:07.406069Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406069Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}]), 17: Succeeded(Object {"key": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7"), "lookup_type": Object {"ById": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Null), 21: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7"), "default_subnet_id": String("e879c791-c017-4ff2-8fbd-628089f569be"), "default_v4_route_id": String("fc09cf8f-6cdb-4797-9b3d-0606d944fed3"), "default_v6_route_id": String("17a3a7f5-e675-4d60-b2d8-2f3235b40870"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("7817a02f-b37d-43c0-a74d-28cbf725b9a9"), "name": String("allow-internal-inbound"), "time_created": String("2026-03-03T18:55:07.406036Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406036Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [Object {"type": String("tcp")}], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("7c6b1bd2-bc6a-4f71-8216-9e01d6d84819"), "name": String("allow-ssh"), "time_created": String("2026-03-03T18:55:07.406059Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406059Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [Object {"type": String("icmp"), "value": Null}], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("e39640f6-deec-49f6-8b33-064cc9b72578"), "name": String("allow-icmp"), "time_created": String("2026-03-03T18:55:07.406069Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.406069Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}], "gateway": Object {"key": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7"), "lookup_type": Object {"ById": String("70e86b0c-15a8-4fcc-88bc-58f8c931f4c7")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, Object {"identity": Object {"description": String("a pier"), "id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "name": String("springfield-squidport"), "time_created": String("2026-03-03T18:55:07.219954Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.219954Z")}, "rcgen": Number(1), "silo_id": String("001de000-5110-4000-8000-000000000000")}], "route": Object {"key": String("bbba3ce2-776f-43c4-befe-386630506b07"), "lookup_type": Object {"ById": String("e879c791-c017-4ff2-8fbd-628089f569be")}, "parent": Object {"key": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "lookup_type": Object {"ById": String("bb01fc78-45a4-4eed-8256-9ed2a649a798")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}}, "route4": Null, "route6": Null, "router": Object {"key": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "lookup_type": Object {"ById": String("bb01fc78-45a4-4eed-8256-9ed2a649a798")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("e879c791-c017-4ff2-8fbd-628089f569be"), "lookup_type": Object {"ById": String("e879c791-c017-4ff2-8fbd-628089f569be")}, "parent": Object {"key": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("e879c791-c017-4ff2-8fbd-628089f569be"), "name": String("default"), "time_created": String("2026-03-03T18:55:07.372258Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:07.372258Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdba:1e8e:1370::/64"), "rcgen": Number(1), "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")}], "subnet_route_id": String("bbba3ce2-776f-43c4-befe-386630506b07"), "system_router_id": String("bb01fc78-45a4-4eed-8256-9ed2a649a798"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "lookup_type": Object {"ByName": String("springfield-squidport")}, "parent": Object {"key": String("001de000-5110-4000-8000-000000000000"), "lookup_type": Object {"ById": String("001de000-5110-4000-8000-000000000000")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdba:1e8e:1370::/48"), "name": String("default")}}, "vpc_id": String("8f0c70af-b9ac-43b8-9313-8c1eb9912011")} }) }
48112026-03-03T18:55:07.648ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48122026-03-03T18:55:07.648ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48132026-03-03T18:55:07.648ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48142026-03-03T18:55:07.648ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48152026-03-03T18:55:07.648ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48162026-03-03T18:55:07.650ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48172026-03-03T18:55:07.652ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48182026-03-03T18:55:07.652ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48192026-03-03T18:55:07.652ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48202026-03-03T18:55:07.652ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/projects
48212026-03-03T18:55:07.654ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 494712 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = fcff3b28-cb07-4837-be3c-340d2d5d7ad3 response_code = 201 uri = /v1/projects
48222026-03-03T18:55:07.654ZINFOtest_instance_metrics (external client test context): client received response status = 201
48232026-03-03T18:55:07.692ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 2 reason = Timeout
48242026-03-03T18:55:07.692ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
48252026-03-03T18:55:07.692ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
48262026-03-03T18:55:07.693ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
48272026-03-03T18:55:07.693ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
48282026-03-03T18:55:07.693ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
48292026-03-03T18:55:07.694ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302026-03-03T18:55:07.698ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
48312026-03-03T18:55:07.698ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
48322026-03-03T18:55:07.698ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
48332026-03-03T18:55:07.699ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
48342026-03-03T18:55:07.700ZDEBGtest_instance_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T18:55:02.625804Z })
48352026-03-03T18:55:07.700ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 7.657352ms iteration = 2 status = {"config_updated":false}
48362026-03-03T18:55:08.306ZTRACtest_instance_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
48372026-03-03T18:55:08.306ZTRACtest_instance_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
48382026-03-03T18:55:08.385ZINFOtest_instance_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
48392026-03-03T18:55:08.385ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
48402026-03-03T18:55:08.385ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 00229e38-3113-4da6-af6c-b88d70b20b55 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
48412026-03-03T18:55:08.385ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 00229e38-3113-4da6-af6c-b88d70b20b55 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
48422026-03-03T18:55:08.386ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 00229e38-3113-4da6-af6c-b88d70b20b55 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
48432026-03-03T18:55:08.386ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 00229e38-3113-4da6-af6c-b88d70b20b55 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
48442026-03-03T18:55:08.386ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 00229e38-3113-4da6-af6c-b88d70b20b55 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
48452026-03-03T18:55:08.389ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 3686 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 00229e38-3113-4da6-af6c-b88d70b20b55 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
48462026-03-03T18:55:08.389ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "00229e38-3113-4da6-af6c-b88d70b20b55", "content-length": "405", "date": "Tue, 03 Mar 2026 18:55:08 GMT"} })
48472026-03-03T18:55:08.390ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
48482026-03-03T18:55:08.390ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 95313626-36a7-449a-abcb-aac2ef98c4a3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
48492026-03-03T18:55:08.390ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 95313626-36a7-449a-abcb-aac2ef98c4a3 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
48502026-03-03T18:55:08.390ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 95313626-36a7-449a-abcb-aac2ef98c4a3 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
48512026-03-03T18:55:08.390ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 95313626-36a7-449a-abcb-aac2ef98c4a3 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
48522026-03-03T18:55:08.390ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 95313626-36a7-449a-abcb-aac2ef98c4a3 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
48532026-03-03T18:55:08.394ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 4216 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = 95313626-36a7-449a-abcb-aac2ef98c4a3 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
48542026-03-03T18:55:08.394ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "95313626-36a7-449a-abcb-aac2ef98c4a3", "content-length": "29", "date": "Tue, 03 Mar 2026 18:55:08 GMT"} })
48552026-03-03T18:55:08.394ZDEBGtest_instance_metrics (oximeter-agent): registered new metric producer address = 127.0.0.1:37169 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
48562026-03-03T18:55:08.394ZDEBGtest_instance_metrics (oximeter-agent): registered new metric producer address = [::1]:42939 collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
48572026-03-03T18:55:08.394ZINFOtest_instance_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
48582026-03-03T18:55:08.403ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48592026-03-03T18:55:08.411ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48602026-03-03T18:55:08.412ZDEBGtest_instance_metrics (collection-task): reporting oximeter self-collection statistics collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48612026-03-03T18:55:08.412ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48622026-03-03T18:55:08.412ZDEBGtest_instance_metrics (collection-task): reporting oximeter self-collection statistics collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48632026-03-03T18:55:08.412ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48642026-03-03T18:55:08.413ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48652026-03-03T18:55:08.413ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48662026-03-03T18:55:08.413ZINFOtest_instance_metrics (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = 127.0.0.1:37169 remote_addr = 127.0.0.1:56348
48672026-03-03T18:55:08.413ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = ceced448-631d-423b-b77f-b881b91282db uri = /913233fe-92a8-4635-9572-183f495429c4
48682026-03-03T18:55:08.417ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 4083 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = ceced448-631d-423b-b77f-b881b91282db response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
48692026-03-03T18:55:08.418ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48702026-03-03T18:55:08.418ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48712026-03-03T18:55:08.418ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48722026-03-03T18:55:08.418ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48732026-03-03T18:55:08.418ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
48742026-03-03T18:55:08.426ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48752026-03-03T18:55:08.426ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48762026-03-03T18:55:08.426ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
48772026-03-03T18:55:08.426ZDEBGtest_instance_metrics (results-sink): inserting 28 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
48782026-03-03T18:55:08.427ZDEBGtest_instance_metrics (results-sink-cluster): inserting 28 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
48792026-03-03T18:55:08.427ZDEBGtest_instance_metrics (clickhouse-client): unrolling 28 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48802026-03-03T18:55:08.427ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48812026-03-03T18:55:08.427ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
48822026-03-03T18:55:08.428ZTRACtest_instance_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48832026-03-03T18:55:08.428ZDEBGtest_instance_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:55:08.427403962Z } timeseries_name = oximeter_collector:collections
48842026-03-03T18:55:08.433ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48852026-03-03T18:55:08.433ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('oximeter_collector:collections') FORMAT Native;
48862026-03-03T18:55:08.434ZTRACtest_instance_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48872026-03-03T18:55:08.434ZDEBGtest_instance_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee schema = TimeseriesSchema { timeseries_name: TimeseriesName("integration_target:integration_metric"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "metric_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:55:08.429403285Z } timeseries_name = integration_target:integration_metric
48882026-03-03T18:55:08.435ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48892026-03-03T18:55:08.435ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
48902026-03-03T18:55:08.436ZTRACtest_instance_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48912026-03-03T18:55:08.436ZDEBGtest_instance_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:55:08.435235614Z } timeseries_name = http_service:request_latency_histogram
48922026-03-03T18:55:08.439ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48932026-03-03T18:55:08.439ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
48942026-03-03T18:55:08.440ZTRACtest_instance_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48952026-03-03T18:55:08.440ZDEBGtest_instance_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:55:08.439636142Z } timeseries_name = collection_target:cpus_provisioned
48962026-03-03T18:55:08.440ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48972026-03-03T18:55:08.440ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
48982026-03-03T18:55:08.441ZTRACtest_instance_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
48992026-03-03T18:55:08.441ZDEBGtest_instance_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:55:08.440768544Z } timeseries_name = collection_target:ram_provisioned
49002026-03-03T18:55:08.441ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
49012026-03-03T18:55:08.441ZTRACtest_instance_metrics (clickhouse-client): executing SQL query collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee sql = SELECT * FROM oximeter.timeseries_schema WHERE timeseries_name NOT IN ('collection_target:cpus_provisioned', 'collection_target:ram_provisioned', 'http_service:request_latency_histogram', 'integration_target:integration_metric', 'oximeter_collector:collections') FORMAT Native;
49022026-03-03T18:55:08.442ZTRACtest_instance_metrics (clickhouse-client): no new timeseries schema in database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
49032026-03-03T18:55:08.442ZDEBGtest_instance_metrics (clickhouse-client): new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-03T18:55:08.441830895Z } timeseries_name = collection_target:virtual_disk_space_provisioned
49042026-03-03T18:55:08.445ZDEBGtest_instance_metrics (clickhouse-client): inserting 6 new timeseries schema collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
49052026-03-03T18:55:08.446ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 6 n_rows = 6 sql = INSERT INTO oximeter.timeseries_schema FORMAT Native
49062026-03-03T18:55:08.447ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 4 sql = INSERT INTO oximeter.fields_ipaddr FORMAT Native
49072026-03-03T18:55:08.448ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 4 table_name = fields_ipaddr
49082026-03-03T18:55:08.448ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
49092026-03-03T18:55:08.449ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 24 table_name = fields_string
49102026-03-03T18:55:08.449ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 14 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
49112026-03-03T18:55:08.449ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 14 table_name = fields_u16
49122026-03-03T18:55:08.450ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 29 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
49132026-03-03T18:55:08.450ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 29 table_name = fields_uuid
49142026-03-03T18:55:08.450ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 5 n_rows = 2 sql = INSERT INTO oximeter.measurements_cumulativeu64 FORMAT Native
49152026-03-03T18:55:08.451ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = measurements_cumulativeu64
49162026-03-03T18:55:08.451ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
49172026-03-03T18:55:08.452ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 10 table_name = measurements_histogramu64
49182026-03-03T18:55:08.453ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
49192026-03-03T18:55:08.453ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_i64
49202026-03-03T18:55:08.453ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
49212026-03-03T18:55:08.528ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
49222026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Action
49232026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AuditLog
49242026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AnyActor
49252026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AuthenticatedActor
49262026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = BlueprintConfig
49272026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Database
49282026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = DnsConfig
49292026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Fleet
49302026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Inventory
49312026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = IpPoolList
49322026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = VpcList
49332026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = ConsoleSessionList
49342026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = DeviceAuthRequestList
49352026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = QuiesceState
49362026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloCertificateList
49372026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloGroupList
49382026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloIdentityProviderList
49392026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloUserList
49402026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloUserSessionList
49412026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloUserTokenList
49422026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SubnetPoolList
49432026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = UpdateTrustRootList
49442026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = TargetReleaseConfig
49452026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AlertClassList
49462026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = ScimClientBearerTokenList
49472026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = MulticastGroupList
49482026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Project
49492026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Disk
49502026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Snapshot
49512026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = ProjectImage
49522026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AffinityGroup
49532026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AntiAffinityGroup
49542026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Instance
49552026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = IpPool
49562026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = InstanceNetworkInterface
49572026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Vpc
49582026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = VpcRouter
49592026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = InternetGateway
49602026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = InternetGatewayIpPool
49612026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = InternetGatewayIpAddress
49622026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = RouterRoute
49632026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = VpcSubnet
49642026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = FloatingIp
49652026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = ExternalSubnet
49662026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Image
49672026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloImage
49682026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AddressLot
49692026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Blueprint
49702026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = LoopbackAddress
49712026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Certificate
49722026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = ConsoleSession
49732026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = DeviceAuthRequest
49742026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = DeviceAccessToken
49752026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = PhysicalDisk
49762026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Rack
49772026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SshKey
49782026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Silo
49792026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloUser
49802026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SiloGroup
49812026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SupportBundle
49822026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = IdentityProvider
49832026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SamlIdentityProvider
49842026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Sled
49852026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = SubnetPool
49862026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = TufRepo
49872026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = TufArtifact
49882026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = TufTrustRoot
49892026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Alert
49902026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = AlertReceiver
49912026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = WebhookSecret
49922026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Zpool
49932026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = Service
49942026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = UserBuiltin
49952026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = ScimClientBearerToken
49962026-03-03T18:55:08.656ZINFOtest_instance_metrics: registering Oso class class = MulticastGroup
49972026-03-03T18:55:08.656ZINFOtest_instance_metrics: full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations; grants project.admin on all projects)\n# - silo.limited-collaborator (grants project.limited-collaborator on all projects)\n# - silo.viewer (can read most resources within the Silo; grants project.viewer)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project, including networking)\n# - project.limited-collaborator (can manage compute resources, but not networking resources)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\n# Note that certain Actors may not ever have any roles assigned to them, like\n# SCIM Actors.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif actor.is_user and silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t# Role hierarchy: admin > collaborator > limited-collaborator > viewer\n\t#\n\t# The "limited-collaborator" role can create/modify non-networking\n\t# resources (instances, disks, etc.) but cannot create/modify networking\n\t# infrastructure (VPCs, subnets, routers, internet gateways).\n\t# See nexus/authz-macros for InProjectLimited vs InProjectFull.\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "limited-collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"limited-collaborator" if "limited-collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_user and silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n}\n# We want to allow the user to modify the ssh key but disallow a SCIM IdP token\n# from doing the same.\nhas_permission(actor: AuthenticatedActor, "modify", ssh_key: SshKey)\n\tif actor.is_user and has_permission(actor, "modify", ssh_key.silo_user);\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource ScimClientBearerToken {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n # necessary to authenticate SCIM actors\n\t"read" if "external-authenticator" on "parent_fleet";\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token: ScimClientBearerToken)\n\tif scim_client_bearer_token.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerToken)\n\tif collection.silo.fleet = fleet;\n\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the quiesce state of a particular Nexus instance.\n#\n# These authz checks must not require the database. We grant this directly to\n# callers of the internal API.\nresource QuiesceState {\n\tpermissions = [ "read", "modify" ];\n}\nhas_permission(USER_INTERNAL_API: AuthenticatedActor, "read", _q: QuiesceState);\nhas_permission(\n USER_INTERNAL_API: AuthenticatedActor,\n "modify",\n _q: QuiesceState\n);\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/update/trust-roots" in the API\nresource UpdateTrustRootList {\n\tpermissions = [ "list_children", "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"list_children" if "viewer" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: UpdateTrustRootList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif actor.is_user and silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for accessing "/v1/multicast-groups" in the API\n# Groups are created when the first instance joins and deleted when the last leaves.\nresource MulticastGroupList {\n\tpermissions = [ "list_children" ];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet Viewers can list multicast groups\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group_list: MulticastGroupList)\n\tif multicast_group_list.fleet = fleet;\n\n# Any authenticated user can list multicast groups in their fleet.\n# This enables silo users to discover groups for attaching instances,\n# without requiring the Fleet::Viewer role.\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group_list: MulticastGroupList)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group_list.fleet;\n\n# MulticastGroup is a fleet-level discovery resource.\n# Join/leave authorization is gated by Instance::Modify, not the group itself.\nresource MulticastGroup {\n\tpermissions = [ "read", "list_children" ];\n\trelations = { parent_fleet: Fleet };\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group: MulticastGroup)\n\tif multicast_group.fleet = fleet;\n\n# Any authenticated user can read multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "read", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Any authenticated user can list members of multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Describes the policy for reading and writing the audit log\nresource AuditLog {\n\tpermissions = [\n\t "list_children", # retrieve audit log\n\t "create_child", # create audit log entry\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet viewers can read the audit log\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\n# Any actor should be able to write to the audit log because we need to be able\n# to write to the log from any request, authenticated or not. Audit log writes\n# are always a byproduct of other operations: there are no endpoints that allow\n# the user to write to the log deliberately. Note we use AuthenticatedActor\n# because we don't really mean unauthenticated -- in the case of login\n# operations, we use the external authenticator actor that creates the session\n# to authorize the audit log write.\nhas_permission(_actor: AuthenticatedActor, "create_child", _audit_log: AuditLog);\n\nhas_relation(fleet: Fleet, "parent_fleet", audit_log: AuditLog)\n\tif audit_log.fleet = fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Allow silo admins to delete and list user sessions\nresource SiloUserSessionList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's sessions.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's sessions.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserSessionList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own sessions\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Allow silo admins to delete and list user access tokens\nresource SiloUserTokenList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's tokens.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's tokens.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserTokenList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own tokens\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on users.\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_user_list: SiloUserList)\n\tif actor.is_scim_idp and silo_user_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_user: SiloUser)\n\tif actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_user_list: SiloUserList)\n if actor.is_scim_idp and silo_user_list.silo in actor.silo;\n\n# Describes the policy for creating and managing Silo groups (mostly intended\n# for API-managed groups)\nresource SiloGroupList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the groups in the\n\t# Silo) can see the groups in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's groups. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloGroupList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloGroupList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on groups.\nhas_permission(actor: AuthenticatedActor, "read", silo_group: SiloGroup)\n if actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_group_list: SiloGroupList)\n\tif actor.is_scim_idp and silo_group_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_group: SiloGroup)\n\tif actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_group_list: SiloGroupList)\n if actor.is_scim_idp and silo_group_list.silo in actor.silo;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest)\n if actor.is_user;\nhas_permission(actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest)\n if actor.is_user;\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_alert_receiver: AlertReceiver };\n\n\t"read" if "read" on "parent_alert_receiver";\n\t"modify" if "modify" on "parent_alert_receiver";\n}\n\nhas_relation(rx: AlertReceiver, "parent_alert_receiver", secret: WebhookSecret)\n\tif secret.alert_receiver = rx;\n\nresource AlertClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: AlertClassList)\n\tif collection.fleet = fleet;\n\nresource ScimClientBearerTokenList {\n\tpermissions = [ "create_child", "list_children" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n # These are all admin because being able to create these tokens would allow\n # a user to grant themselves admin by modifying group membership through SCIM calls\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_silo";\n\n # Fleet-level roles also grant privileges for SCIM client tokens, for\n # configuration before silo admins are present.\n\t"create_child" if "admin" on "parent_fleet";\n\t"list_children" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token_list: ScimClientBearerTokenList)\n\tif scim_client_bearer_token_list.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerTokenList)\n\tif collection.silo.fleet = fleet;\n\n# VpcList is a synthetic resource for controlling VPC creation.\n# Unlike other project resources, VPC creation requires the full "collaborator"\n# role rather than "limited-collaborator", enforcing the networking restriction.\n# This allows organizations to restrict who can reconfigure the network topology\n# while still allowing users with limited-collaborator to work with compute\n# resources (instances, disks, etc.) within the existing network.\nresource VpcList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { containing_project: Project };\n\n\t"list_children" if "read" on "containing_project";\n\t"create_child" if "collaborator" on "containing_project";\n}\nhas_relation(project: Project, "containing_project", collection: VpcList)\n\tif collection.project = project;\n\n# Describes the policy for accessing "/v1/system/subnet-pools" in the API\nresource SubnetPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the Subnet Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list External Subnet Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", subnet_pool_list: SubnetPoolList)\n\tif subnet_pool_list.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource ExternalSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ExternalSubnet)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource SubnetPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SubnetPool)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource TufTrustRoot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufTrustRoot)\n if child.fleet = fleet;\n \n\n resource Alert {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Alert)\n if child.fleet = fleet;\n \n\n resource AlertReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AlertReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n \n\n
49982026-03-03T18:55:08.669ZTRACtest_instance_metrics: authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
49992026-03-03T18:55:08.669ZDEBGtest_instance_metrics: roles roles = RoleSet { roles: {} }
50002026-03-03T18:55:08.669ZDEBGtest_instance_metrics: authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
50012026-03-03T18:55:08.671ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50022026-03-03T18:55:08.671ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50032026-03-03T18:55:08.671ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50042026-03-03T18:55:08.671ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50052026-03-03T18:55:08.671ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50062026-03-03T18:55:08.671ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50072026-03-03T18:55:08.672ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50082026-03-03T18:55:08.672ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50092026-03-03T18:55:08.672ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1 version = 2026021900.0.0
50102026-03-03T18:55:08.672ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = e5cd8c7a-b25a-4f4a-8eff-40155170efd0 uri = /913233fe-92a8-4635-9572-183f495429c4
50112026-03-03T18:55:08.672ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50122026-03-03T18:55:08.672ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50132026-03-03T18:55:08.672ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50142026-03-03T18:55:08.672ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50152026-03-03T18:55:08.673ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50162026-03-03T18:55:08.678ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5497 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = e5cd8c7a-b25a-4f4a-8eff-40155170efd0 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
50172026-03-03T18:55:08.678ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50182026-03-03T18:55:08.678ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50192026-03-03T18:55:08.678ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50202026-03-03T18:55:08.678ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50212026-03-03T18:55:08.678ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
50222026-03-03T18:55:08.688ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50232026-03-03T18:55:08.688ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50242026-03-03T18:55:08.688ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
50252026-03-03T18:55:08.688ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
50262026-03-03T18:55:08.688ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
50272026-03-03T18:55:08.688ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
50282026-03-03T18:55:08.688ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
50292026-03-03T18:55:08.688ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50302026-03-03T18:55:08.688ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50312026-03-03T18:55:08.689ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50322026-03-03T18:55:08.690ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
50332026-03-03T18:55:08.690ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
50342026-03-03T18:55:08.690ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
50352026-03-03T18:55:08.690ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
50362026-03-03T18:55:08.690ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50372026-03-03T18:55:08.690ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50382026-03-03T18:55:08.691ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50392026-03-03T18:55:08.691ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
50402026-03-03T18:55:08.691ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
50412026-03-03T18:55:08.691ZDEBGtest_instance_metrics (results-sink): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
50422026-03-03T18:55:08.692ZDEBGtest_instance_metrics (clickhouse-client): unrolling 10 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
50432026-03-03T18:55:08.695ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 20 sql = INSERT INTO oximeter.fields_string FORMAT Native
50442026-03-03T18:55:08.696ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50452026-03-03T18:55:08.696ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50462026-03-03T18:55:08.696ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50472026-03-03T18:55:08.696ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50482026-03-03T18:55:08.697ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 20 table_name = fields_string
50492026-03-03T18:55:08.697ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
50502026-03-03T18:55:08.697ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
50512026-03-03T18:55:08.699ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
50522026-03-03T18:55:08.699ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50532026-03-03T18:55:08.699ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50542026-03-03T18:55:08.700ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50552026-03-03T18:55:08.700ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 10 table_name = fields_u16
50562026-03-03T18:55:08.700ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 10 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
50572026-03-03T18:55:08.701ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
50582026-03-03T18:55:08.701ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
50592026-03-03T18:55:08.701ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50602026-03-03T18:55:08.701ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50612026-03-03T18:55:08.701ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50622026-03-03T18:55:08.702ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 10 table_name = fields_uuid
50632026-03-03T18:55:08.702ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 10 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
50642026-03-03T18:55:08.702ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
50652026-03-03T18:55:08.702ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
50662026-03-03T18:55:08.702ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
50672026-03-03T18:55:08.703ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
50682026-03-03T18:55:08.704ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
50692026-03-03T18:55:08.706ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
50702026-03-03T18:55:08.706ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50712026-03-03T18:55:08.706ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50722026-03-03T18:55:08.706ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50732026-03-03T18:55:08.706ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50742026-03-03T18:55:08.706ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50752026-03-03T18:55:08.706ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50762026-03-03T18:55:08.707ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 10 table_name = measurements_histogramu64
50772026-03-03T18:55:08.707ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
50782026-03-03T18:55:08.708ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50792026-03-03T18:55:08.708ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50802026-03-03T18:55:08.708ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50812026-03-03T18:55:08.708ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50822026-03-03T18:55:08.709ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50832026-03-03T18:55:08.711ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50842026-03-03T18:55:08.711ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50852026-03-03T18:55:08.711ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50862026-03-03T18:55:08.711ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50872026-03-03T18:55:08.711ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50882026-03-03T18:55:08.711ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50892026-03-03T18:55:08.713ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50902026-03-03T18:55:08.713ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50912026-03-03T18:55:08.713ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50922026-03-03T18:55:08.713ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50932026-03-03T18:55:08.714ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50942026-03-03T18:55:08.716ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
50952026-03-03T18:55:08.716ZDEBGtest_instance_metrics (clickhouse-client): retrieving timeseries schema from database id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9
50962026-03-03T18:55:08.716ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.timeseries_schema FORMAT Native;
50972026-03-03T18:55:08.718ZTRACtest_instance_metrics (clickhouse-client): retrieved new timeseries schema id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 n_schema = 6
50982026-03-03T18:55:08.721ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
50992026-03-03T18:55:08.723ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:08.671492493' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
51002026-03-03T18:55:08.724ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 52450 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 39da4c09-c62d-4b3f-aa38-ec6f1a2344e7 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.671492493Z&order=descending&limit=1
51012026-03-03T18:55:08.725ZINFOtest_instance_metrics (external client test context): client received response status = 200
51022026-03-03T18:55:08.725ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51032026-03-03T18:55:08.725ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51042026-03-03T18:55:08.725ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51052026-03-03T18:55:08.725ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51062026-03-03T18:55:08.725ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51072026-03-03T18:55:08.725ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51082026-03-03T18:55:08.725ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51092026-03-03T18:55:08.725ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51102026-03-03T18:55:08.725ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1 version = 2026021900.0.0
51112026-03-03T18:55:08.726ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 4e58da6c-dc6b-45ac-87c7-182fd6241e4f uri = /913233fe-92a8-4635-9572-183f495429c4
51122026-03-03T18:55:08.726ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51132026-03-03T18:55:08.726ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51142026-03-03T18:55:08.726ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51152026-03-03T18:55:08.726ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51162026-03-03T18:55:08.726ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51172026-03-03T18:55:08.731ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5252 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 4e58da6c-dc6b-45ac-87c7-182fd6241e4f response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
51182026-03-03T18:55:08.731ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51192026-03-03T18:55:08.736ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51202026-03-03T18:55:08.736ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51212026-03-03T18:55:08.736ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51222026-03-03T18:55:08.736ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51232026-03-03T18:55:08.737ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51242026-03-03T18:55:08.737ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51252026-03-03T18:55:08.737ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51262026-03-03T18:55:08.737ZDEBGtest_instance_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
51272026-03-03T18:55:08.737ZDEBGtest_instance_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
51282026-03-03T18:55:08.741ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
51292026-03-03T18:55:08.742ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51302026-03-03T18:55:08.742ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51312026-03-03T18:55:08.742ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51322026-03-03T18:55:08.748ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
51332026-03-03T18:55:08.749ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
51342026-03-03T18:55:08.749ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51352026-03-03T18:55:08.749ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51362026-03-03T18:55:08.749ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51372026-03-03T18:55:08.750ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51382026-03-03T18:55:08.750ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51392026-03-03T18:55:08.750ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51402026-03-03T18:55:08.751ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51412026-03-03T18:55:08.753ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
51422026-03-03T18:55:08.755ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
51432026-03-03T18:55:08.755ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51442026-03-03T18:55:08.755ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51452026-03-03T18:55:08.755ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51462026-03-03T18:55:08.759ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
51472026-03-03T18:55:08.759ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
51482026-03-03T18:55:08.759ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51492026-03-03T18:55:08.759ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51502026-03-03T18:55:08.760ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51512026-03-03T18:55:08.761ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
51522026-03-03T18:55:08.761ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
51532026-03-03T18:55:08.761ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
51542026-03-03T18:55:08.761ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
51552026-03-03T18:55:08.762ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
51562026-03-03T18:55:08.764ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
51572026-03-03T18:55:08.764ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51582026-03-03T18:55:08.764ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51592026-03-03T18:55:08.764ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51602026-03-03T18:55:08.764ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51612026-03-03T18:55:08.764ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51622026-03-03T18:55:08.764ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51632026-03-03T18:55:08.766ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51642026-03-03T18:55:08.766ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51652026-03-03T18:55:08.766ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51662026-03-03T18:55:08.766ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51672026-03-03T18:55:08.768ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51682026-03-03T18:55:08.769ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51692026-03-03T18:55:08.769ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51702026-03-03T18:55:08.769ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51712026-03-03T18:55:08.769ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51722026-03-03T18:55:08.769ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51732026-03-03T18:55:08.770ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51742026-03-03T18:55:08.771ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51752026-03-03T18:55:08.771ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51762026-03-03T18:55:08.771ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51772026-03-03T18:55:08.771ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51782026-03-03T18:55:08.773ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51792026-03-03T18:55:08.774ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51802026-03-03T18:55:08.776ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
51812026-03-03T18:55:08.781ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_string
51822026-03-03T18:55:08.784ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
51832026-03-03T18:55:08.784ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:08.725342579' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
51842026-03-03T18:55:08.785ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_u16
51852026-03-03T18:55:08.785ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
51862026-03-03T18:55:08.786ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
51872026-03-03T18:55:08.786ZDEBGtest_instance_metrics (results-sink-cluster): inserting 10 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
51882026-03-03T18:55:08.789ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_uuid
51892026-03-03T18:55:08.789ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
51902026-03-03T18:55:08.789ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 63773 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9839c9b9-111a-420c-bfd6-4ad6cd2166a6 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.725342579Z&order=descending&limit=1
51912026-03-03T18:55:08.790ZINFOtest_instance_metrics (external client test context): client received response status = 200
51922026-03-03T18:55:08.791ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
51932026-03-03T18:55:08.791ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51942026-03-03T18:55:08.791ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51952026-03-03T18:55:08.791ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51962026-03-03T18:55:08.791ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51972026-03-03T18:55:08.791ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
51982026-03-03T18:55:08.791ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
51992026-03-03T18:55:08.791ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52002026-03-03T18:55:08.791ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1 version = 2026021900.0.0
52012026-03-03T18:55:08.791ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = measurements_histogramu64
52022026-03-03T18:55:08.791ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52032026-03-03T18:55:08.791ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52042026-03-03T18:55:08.791ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 3f890abe-61df-4b9b-90ef-8fe72e86af07 uri = /913233fe-92a8-4635-9572-183f495429c4
52052026-03-03T18:55:08.791ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52062026-03-03T18:55:08.791ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52072026-03-03T18:55:08.791ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52082026-03-03T18:55:08.791ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52092026-03-03T18:55:08.792ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52102026-03-03T18:55:08.797ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5919 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 3f890abe-61df-4b9b-90ef-8fe72e86af07 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
52112026-03-03T18:55:08.797ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
52122026-03-03T18:55:08.798ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
52132026-03-03T18:55:08.799ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
52142026-03-03T18:55:08.804ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
52152026-03-03T18:55:08.804ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
52162026-03-03T18:55:08.804ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
52172026-03-03T18:55:08.804ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
52182026-03-03T18:55:08.805ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
52192026-03-03T18:55:08.805ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
52202026-03-03T18:55:08.805ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
52212026-03-03T18:55:08.805ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
52222026-03-03T18:55:08.805ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
52232026-03-03T18:55:08.806ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52242026-03-03T18:55:08.806ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52252026-03-03T18:55:08.806ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52262026-03-03T18:55:08.808ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
52272026-03-03T18:55:08.808ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
52282026-03-03T18:55:08.808ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52292026-03-03T18:55:08.808ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52302026-03-03T18:55:08.808ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52312026-03-03T18:55:08.809ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
52322026-03-03T18:55:08.809ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52332026-03-03T18:55:08.809ZDEBGtest_instance_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52342026-03-03T18:55:08.809ZDEBGtest_instance_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
52352026-03-03T18:55:08.813ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
52362026-03-03T18:55:08.814ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52372026-03-03T18:55:08.814ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52382026-03-03T18:55:08.814ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52392026-03-03T18:55:08.814ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52402026-03-03T18:55:08.815ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_string
52412026-03-03T18:55:08.815ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
52422026-03-03T18:55:08.816ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
52432026-03-03T18:55:08.818ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
52442026-03-03T18:55:08.820ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52452026-03-03T18:55:08.820ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52462026-03-03T18:55:08.820ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52472026-03-03T18:55:08.820ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_u16
52482026-03-03T18:55:08.820ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
52492026-03-03T18:55:08.820ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
52502026-03-03T18:55:08.820ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
52512026-03-03T18:55:08.820ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52522026-03-03T18:55:08.820ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52532026-03-03T18:55:08.820ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52542026-03-03T18:55:08.821ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_uuid
52552026-03-03T18:55:08.821ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
52562026-03-03T18:55:08.821ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
52572026-03-03T18:55:08.821ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
52582026-03-03T18:55:08.821ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
52592026-03-03T18:55:08.822ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
52602026-03-03T18:55:08.823ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
52612026-03-03T18:55:08.825ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
52622026-03-03T18:55:08.825ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52632026-03-03T18:55:08.825ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52642026-03-03T18:55:08.825ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52652026-03-03T18:55:08.825ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52662026-03-03T18:55:08.825ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52672026-03-03T18:55:08.825ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52682026-03-03T18:55:08.826ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = measurements_histogramu64
52692026-03-03T18:55:08.826ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52702026-03-03T18:55:08.826ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52712026-03-03T18:55:08.826ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
52722026-03-03T18:55:08.827ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
52732026-03-03T18:55:08.828ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52742026-03-03T18:55:08.828ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52752026-03-03T18:55:08.828ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52762026-03-03T18:55:08.828ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52772026-03-03T18:55:08.829ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
52782026-03-03T18:55:08.829ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
52792026-03-03T18:55:08.829ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
52802026-03-03T18:55:08.829ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
52812026-03-03T18:55:08.830ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52822026-03-03T18:55:08.831ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52832026-03-03T18:55:08.831ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52842026-03-03T18:55:08.831ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52852026-03-03T18:55:08.831ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52862026-03-03T18:55:08.831ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52872026-03-03T18:55:08.832ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52882026-03-03T18:55:08.833ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52892026-03-03T18:55:08.833ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52902026-03-03T18:55:08.833ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52912026-03-03T18:55:08.834ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52922026-03-03T18:55:08.835ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52932026-03-03T18:55:08.837ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52942026-03-03T18:55:08.838ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
52952026-03-03T18:55:08.841ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:08.790469313' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
52962026-03-03T18:55:08.843ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 51894 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f0ecd210-b6cb-4f9b-90c1-eb9d5ed74d30 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.790469313Z&order=descending&limit=1
52972026-03-03T18:55:08.843ZINFOtest_instance_metrics (external client test context): client received response status = 200
52982026-03-03T18:55:08.843ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
52992026-03-03T18:55:08.843ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53002026-03-03T18:55:08.843ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53012026-03-03T18:55:08.843ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53022026-03-03T18:55:08.843ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53032026-03-03T18:55:08.843ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53042026-03-03T18:55:08.843ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53052026-03-03T18:55:08.844ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53062026-03-03T18:55:08.844ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
53072026-03-03T18:55:08.844ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 8c2fc8c2-4a56-4b94-83e7-5309d5a4997d uri = /913233fe-92a8-4635-9572-183f495429c4
53082026-03-03T18:55:08.844ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53092026-03-03T18:55:08.844ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53102026-03-03T18:55:08.844ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53112026-03-03T18:55:08.844ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53122026-03-03T18:55:08.845ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53132026-03-03T18:55:08.853ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5624 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 8c2fc8c2-4a56-4b94-83e7-5309d5a4997d response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
53142026-03-03T18:55:08.853ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53152026-03-03T18:55:08.855ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53162026-03-03T18:55:08.856ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53172026-03-03T18:55:08.856ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
53182026-03-03T18:55:08.856ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53192026-03-03T18:55:08.856ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53202026-03-03T18:55:08.856ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53212026-03-03T18:55:08.856ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
53222026-03-03T18:55:08.856ZDEBGtest_instance_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
53232026-03-03T18:55:08.856ZDEBGtest_instance_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
53242026-03-03T18:55:08.860ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
53252026-03-03T18:55:08.861ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53262026-03-03T18:55:08.861ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53272026-03-03T18:55:08.861ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53282026-03-03T18:55:08.862ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_string
53292026-03-03T18:55:08.862ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
53302026-03-03T18:55:08.863ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
53312026-03-03T18:55:08.863ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
53322026-03-03T18:55:08.863ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53332026-03-03T18:55:08.863ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53342026-03-03T18:55:08.864ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53352026-03-03T18:55:08.864ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_u16
53362026-03-03T18:55:08.864ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
53372026-03-03T18:55:08.865ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53382026-03-03T18:55:08.865ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53392026-03-03T18:55:08.865ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53402026-03-03T18:55:08.865ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53412026-03-03T18:55:08.866ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_uuid
53422026-03-03T18:55:08.866ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
53432026-03-03T18:55:08.866ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
53442026-03-03T18:55:08.868ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
53452026-03-03T18:55:08.868ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53462026-03-03T18:55:08.869ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53472026-03-03T18:55:08.869ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53482026-03-03T18:55:08.870ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
53492026-03-03T18:55:08.870ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
53502026-03-03T18:55:08.870ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53512026-03-03T18:55:08.870ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53522026-03-03T18:55:08.870ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53532026-03-03T18:55:08.871ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = measurements_histogramu64
53542026-03-03T18:55:08.871ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
53552026-03-03T18:55:08.871ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
53562026-03-03T18:55:08.871ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
53572026-03-03T18:55:08.872ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
53582026-03-03T18:55:08.872ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
53592026-03-03T18:55:08.872ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
53602026-03-03T18:55:08.872ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
53612026-03-03T18:55:08.873ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
53622026-03-03T18:55:08.874ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
53632026-03-03T18:55:08.875ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
53642026-03-03T18:55:08.876ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53652026-03-03T18:55:08.876ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53662026-03-03T18:55:08.876ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53672026-03-03T18:55:08.876ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53682026-03-03T18:55:08.876ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53692026-03-03T18:55:08.876ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53702026-03-03T18:55:08.876ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
53712026-03-03T18:55:08.876ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
53722026-03-03T18:55:08.877ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53732026-03-03T18:55:08.878ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53742026-03-03T18:55:08.878ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53752026-03-03T18:55:08.878ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53762026-03-03T18:55:08.878ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
53772026-03-03T18:55:08.878ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
53782026-03-03T18:55:08.879ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53792026-03-03T18:55:08.881ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53802026-03-03T18:55:08.881ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53812026-03-03T18:55:08.881ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53822026-03-03T18:55:08.881ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53832026-03-03T18:55:08.882ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53842026-03-03T18:55:08.882ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53852026-03-03T18:55:08.883ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53862026-03-03T18:55:08.884ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53872026-03-03T18:55:08.884ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53882026-03-03T18:55:08.884ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53892026-03-03T18:55:08.884ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53902026-03-03T18:55:08.884ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53912026-03-03T18:55:08.885ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53922026-03-03T18:55:08.886ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53932026-03-03T18:55:08.886ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53942026-03-03T18:55:08.886ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53952026-03-03T18:55:08.887ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
53962026-03-03T18:55:08.887ZDEBGtest_instance_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
53972026-03-03T18:55:08.887ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53982026-03-03T18:55:08.887ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
53992026-03-03T18:55:08.887ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54002026-03-03T18:55:08.888ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54012026-03-03T18:55:08.889ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54022026-03-03T18:55:08.893ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54032026-03-03T18:55:08.893ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54042026-03-03T18:55:08.893ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54052026-03-03T18:55:08.893ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54062026-03-03T18:55:08.893ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54072026-03-03T18:55:08.893ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54082026-03-03T18:55:08.895ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54092026-03-03T18:55:08.895ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54102026-03-03T18:55:08.895ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54112026-03-03T18:55:08.895ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54122026-03-03T18:55:08.897ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54132026-03-03T18:55:08.898ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54142026-03-03T18:55:08.900ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
54152026-03-03T18:55:08.903ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (10855055105004541248) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:08.843500788' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
54162026-03-03T18:55:08.905ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 61216 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 23b90ef7-d361-4995-a29d-345499f8ee89 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.843500788Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54172026-03-03T18:55:08.905ZINFOtest_instance_metrics (external client test context): client received response status = 200
54182026-03-03T18:55:08.905ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54192026-03-03T18:55:08.905ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54202026-03-03T18:55:08.905ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54212026-03-03T18:55:08.906ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54222026-03-03T18:55:08.906ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54232026-03-03T18:55:08.906ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54242026-03-03T18:55:08.906ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54252026-03-03T18:55:08.906ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54262026-03-03T18:55:08.906ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
54272026-03-03T18:55:08.906ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 42bdd79e-9e09-43d1-b9fd-31ce7999199e uri = /913233fe-92a8-4635-9572-183f495429c4
54282026-03-03T18:55:08.906ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54292026-03-03T18:55:08.906ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54302026-03-03T18:55:08.906ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54312026-03-03T18:55:08.906ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54322026-03-03T18:55:08.907ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54332026-03-03T18:55:08.912ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5697 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 42bdd79e-9e09-43d1-b9fd-31ce7999199e response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
54342026-03-03T18:55:08.912ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54352026-03-03T18:55:08.917ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54362026-03-03T18:55:08.917ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54372026-03-03T18:55:08.917ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
54382026-03-03T18:55:08.918ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54392026-03-03T18:55:08.918ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54402026-03-03T18:55:08.918ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54412026-03-03T18:55:08.918ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
54422026-03-03T18:55:08.918ZDEBGtest_instance_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
54432026-03-03T18:55:08.918ZDEBGtest_instance_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
54442026-03-03T18:55:08.922ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
54452026-03-03T18:55:08.922ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54462026-03-03T18:55:08.922ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54472026-03-03T18:55:08.923ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54482026-03-03T18:55:08.924ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
54492026-03-03T18:55:08.924ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
54502026-03-03T18:55:08.924ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54512026-03-03T18:55:08.924ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54522026-03-03T18:55:08.925ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54532026-03-03T18:55:08.925ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_string
54542026-03-03T18:55:08.926ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
54552026-03-03T18:55:08.926ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54562026-03-03T18:55:08.926ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54572026-03-03T18:55:08.926ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54582026-03-03T18:55:08.927ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54592026-03-03T18:55:08.927ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_u16
54602026-03-03T18:55:08.929ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
54612026-03-03T18:55:08.929ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
54622026-03-03T18:55:08.930ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
54632026-03-03T18:55:08.930ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54642026-03-03T18:55:08.930ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54652026-03-03T18:55:08.930ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54662026-03-03T18:55:08.931ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_uuid
54672026-03-03T18:55:08.931ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
54682026-03-03T18:55:08.931ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
54692026-03-03T18:55:08.932ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
54702026-03-03T18:55:08.932ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54712026-03-03T18:55:08.932ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54722026-03-03T18:55:08.932ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54732026-03-03T18:55:08.934ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
54742026-03-03T18:55:08.934ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
54752026-03-03T18:55:08.934ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
54762026-03-03T18:55:08.934ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
54772026-03-03T18:55:08.935ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = measurements_histogramu64
54782026-03-03T18:55:08.935ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
54792026-03-03T18:55:08.935ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
54802026-03-03T18:55:08.935ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
54812026-03-03T18:55:08.935ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
54822026-03-03T18:55:08.936ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
54832026-03-03T18:55:08.938ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
54842026-03-03T18:55:08.938ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54852026-03-03T18:55:08.938ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54862026-03-03T18:55:08.938ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54872026-03-03T18:55:08.938ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54882026-03-03T18:55:08.938ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54892026-03-03T18:55:08.938ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54902026-03-03T18:55:08.940ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
54912026-03-03T18:55:08.940ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
54922026-03-03T18:55:08.942ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
54932026-03-03T18:55:08.942ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
54942026-03-03T18:55:08.942ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54952026-03-03T18:55:08.942ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54962026-03-03T18:55:08.942ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54972026-03-03T18:55:08.942ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54982026-03-03T18:55:08.948ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
54992026-03-03T18:55:08.948ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55002026-03-03T18:55:08.948ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55012026-03-03T18:55:08.948ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55022026-03-03T18:55:08.948ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55032026-03-03T18:55:08.953ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55042026-03-03T18:55:08.953ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55052026-03-03T18:55:08.954ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55062026-03-03T18:55:08.955ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55072026-03-03T18:55:08.955ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55082026-03-03T18:55:08.955ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55092026-03-03T18:55:08.955ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55102026-03-03T18:55:08.956ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55112026-03-03T18:55:08.957ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55122026-03-03T18:55:08.957ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55132026-03-03T18:55:08.957ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55142026-03-03T18:55:08.958ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55152026-03-03T18:55:08.959ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55162026-03-03T18:55:08.959ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55172026-03-03T18:55:08.960ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55182026-03-03T18:55:08.960ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55192026-03-03T18:55:08.961ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55202026-03-03T18:55:08.966ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55212026-03-03T18:55:08.966ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55222026-03-03T18:55:08.966ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55232026-03-03T18:55:08.966ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55242026-03-03T18:55:08.966ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55252026-03-03T18:55:08.967ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55262026-03-03T18:55:08.969ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55272026-03-03T18:55:08.969ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55282026-03-03T18:55:08.969ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55292026-03-03T18:55:08.969ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55302026-03-03T18:55:08.971ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55312026-03-03T18:55:08.972ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55322026-03-03T18:55:08.976ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
55332026-03-03T18:55:08.977ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (15918897146657644681) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:08.905780437' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
55342026-03-03T18:55:08.979ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 72625 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3bbb2b97-6ad4-44c7-88ff-4649b4db9b8d response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.905780437Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55352026-03-03T18:55:08.979ZINFOtest_instance_metrics (external client test context): client received response status = 200
55362026-03-03T18:55:08.979ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55372026-03-03T18:55:08.979ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55382026-03-03T18:55:08.979ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55392026-03-03T18:55:08.979ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55402026-03-03T18:55:08.979ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55412026-03-03T18:55:08.979ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55422026-03-03T18:55:08.979ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55432026-03-03T18:55:08.980ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55442026-03-03T18:55:08.980ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
55452026-03-03T18:55:08.980ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 68ae4eeb-a83e-4d4e-9826-70bd141b9f77 uri = /913233fe-92a8-4635-9572-183f495429c4
55462026-03-03T18:55:08.980ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55472026-03-03T18:55:08.980ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
55482026-03-03T18:55:08.980ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
55492026-03-03T18:55:08.980ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
55502026-03-03T18:55:08.981ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
55512026-03-03T18:55:08.985ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5621 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 68ae4eeb-a83e-4d4e-9826-70bd141b9f77 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
55522026-03-03T18:55:08.986ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55532026-03-03T18:55:08.991ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55542026-03-03T18:55:08.991ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55552026-03-03T18:55:08.991ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
55562026-03-03T18:55:08.991ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55572026-03-03T18:55:08.991ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55582026-03-03T18:55:08.991ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55592026-03-03T18:55:08.991ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
55602026-03-03T18:55:08.991ZDEBGtest_instance_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55612026-03-03T18:55:08.992ZDEBGtest_instance_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
55622026-03-03T18:55:08.996ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
55632026-03-03T18:55:08.996ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
55642026-03-03T18:55:08.996ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55652026-03-03T18:55:08.996ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
55662026-03-03T18:55:08.997ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
55672026-03-03T18:55:08.997ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
55682026-03-03T18:55:08.998ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_string
55692026-03-03T18:55:08.998ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
55702026-03-03T18:55:08.999ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
55712026-03-03T18:55:08.999ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
55722026-03-03T18:55:08.999ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
55732026-03-03T18:55:08.999ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
55742026-03-03T18:55:08.999ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
55752026-03-03T18:55:09.001ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_u16
55762026-03-03T18:55:09.001ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
55772026-03-03T18:55:09.004ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_uuid
55782026-03-03T18:55:09.004ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
55792026-03-03T18:55:09.005ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = measurements_histogramu64
55802026-03-03T18:55:09.005ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55812026-03-03T18:55:09.005ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
55822026-03-03T18:55:09.005ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
55832026-03-03T18:55:09.006ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
55842026-03-03T18:55:09.007ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
55852026-03-03T18:55:09.010ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
55862026-03-03T18:55:09.010ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
55872026-03-03T18:55:09.010ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
55882026-03-03T18:55:09.010ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
55892026-03-03T18:55:09.011ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
55902026-03-03T18:55:09.011ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
55912026-03-03T18:55:09.011ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
55922026-03-03T18:55:09.011ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
55932026-03-03T18:55:09.012ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
55942026-03-03T18:55:09.013ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
55952026-03-03T18:55:09.013ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
55962026-03-03T18:55:09.013ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
55972026-03-03T18:55:09.013ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
55982026-03-03T18:55:09.013ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
55992026-03-03T18:55:09.013ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
56002026-03-03T18:55:09.020ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56012026-03-03T18:55:09.020ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
56022026-03-03T18:55:09.020ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
56032026-03-03T18:55:09.020ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
56042026-03-03T18:55:09.020ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
56052026-03-03T18:55:09.020ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
56062026-03-03T18:55:09.020ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
56072026-03-03T18:55:09.020ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
56082026-03-03T18:55:09.020ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56092026-03-03T18:55:09.020ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56102026-03-03T18:55:09.020ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56112026-03-03T18:55:09.020ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56122026-03-03T18:55:09.020ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56132026-03-03T18:55:09.020ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56142026-03-03T18:55:09.020ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56152026-03-03T18:55:09.020ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56162026-03-03T18:55:09.020ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56172026-03-03T18:55:09.021ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56182026-03-03T18:55:09.022ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56192026-03-03T18:55:09.024ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56202026-03-03T18:55:09.024ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56212026-03-03T18:55:09.024ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56222026-03-03T18:55:09.024ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56232026-03-03T18:55:09.028ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56242026-03-03T18:55:09.028ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56252026-03-03T18:55:09.029ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56262026-03-03T18:55:09.030ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56272026-03-03T18:55:09.030ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56282026-03-03T18:55:09.030ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56292026-03-03T18:55:09.030ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56302026-03-03T18:55:09.030ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56312026-03-03T18:55:09.032ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56322026-03-03T18:55:09.032ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56332026-03-03T18:55:09.032ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56342026-03-03T18:55:09.032ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56352026-03-03T18:55:09.034ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56362026-03-03T18:55:09.034ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56372026-03-03T18:55:09.034ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56382026-03-03T18:55:09.034ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56392026-03-03T18:55:09.036ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56402026-03-03T18:55:09.040ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56412026-03-03T18:55:09.040ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56422026-03-03T18:55:09.040ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56432026-03-03T18:55:09.040ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56442026-03-03T18:55:09.040ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56452026-03-03T18:55:09.040ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56462026-03-03T18:55:09.042ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56472026-03-03T18:55:09.042ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56482026-03-03T18:55:09.042ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56492026-03-03T18:55:09.042ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56502026-03-03T18:55:09.044ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56512026-03-03T18:55:09.045ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56522026-03-03T18:55:09.047ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
56532026-03-03T18:55:09.050ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (9666909797316088926) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:08.979493216' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
56542026-03-03T18:55:09.055ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 75270 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9cb5fd06-3da4-401f-82db-36ebe90c4373 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:08.979493216Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
56552026-03-03T18:55:09.055ZINFOtest_instance_metrics (external client test context): client received response status = 200
56562026-03-03T18:55:09.055ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
56572026-03-03T18:55:09.056ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56582026-03-03T18:55:09.056ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56592026-03-03T18:55:09.056ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56602026-03-03T18:55:09.056ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56612026-03-03T18:55:09.056ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56622026-03-03T18:55:09.056ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56632026-03-03T18:55:09.056ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
56642026-03-03T18:55:09.056ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1 version = 2026021900.0.0
56652026-03-03T18:55:09.056ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = bb42a17f-7de8-445c-8df6-a95291dc8264 uri = /913233fe-92a8-4635-9572-183f495429c4
56662026-03-03T18:55:09.056ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
56672026-03-03T18:55:09.056ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
56682026-03-03T18:55:09.056ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
56692026-03-03T18:55:09.056ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
56702026-03-03T18:55:09.057ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
56712026-03-03T18:55:09.062ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5683 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = bb42a17f-7de8-445c-8df6-a95291dc8264 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
56722026-03-03T18:55:09.062ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56732026-03-03T18:55:09.067ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56742026-03-03T18:55:09.067ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56752026-03-03T18:55:09.067ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
56762026-03-03T18:55:09.067ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56772026-03-03T18:55:09.068ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56782026-03-03T18:55:09.068ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56792026-03-03T18:55:09.068ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
56802026-03-03T18:55:09.068ZDEBGtest_instance_metrics (results-sink): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
56812026-03-03T18:55:09.068ZDEBGtest_instance_metrics (clickhouse-client): unrolling 11 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
56822026-03-03T18:55:09.072ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_string FORMAT Native
56832026-03-03T18:55:09.074ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
56842026-03-03T18:55:09.074ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
56852026-03-03T18:55:09.074ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
56862026-03-03T18:55:09.075ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_string
56872026-03-03T18:55:09.075ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
56882026-03-03T18:55:09.076ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_u16
56892026-03-03T18:55:09.076ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 11 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
56902026-03-03T18:55:09.076ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
56912026-03-03T18:55:09.076ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
56922026-03-03T18:55:09.076ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
56932026-03-03T18:55:09.076ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
56942026-03-03T18:55:09.077ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
56952026-03-03T18:55:09.078ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = fields_uuid
56962026-03-03T18:55:09.078ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 11 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
56972026-03-03T18:55:09.078ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
56982026-03-03T18:55:09.078ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
56992026-03-03T18:55:09.078ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57002026-03-03T18:55:09.079ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57012026-03-03T18:55:09.080ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
57022026-03-03T18:55:09.082ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
57032026-03-03T18:55:09.082ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57042026-03-03T18:55:09.082ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57052026-03-03T18:55:09.082ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57062026-03-03T18:55:09.083ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 11 table_name = measurements_histogramu64
57072026-03-03T18:55:09.083ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57082026-03-03T18:55:09.083ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57092026-03-03T18:55:09.083ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
57102026-03-03T18:55:09.084ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
57112026-03-03T18:55:09.084ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
57122026-03-03T18:55:09.084ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
57132026-03-03T18:55:09.084ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57142026-03-03T18:55:09.084ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57152026-03-03T18:55:09.085ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57162026-03-03T18:55:09.085ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
57172026-03-03T18:55:09.085ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
57182026-03-03T18:55:09.086ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57192026-03-03T18:55:09.086ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57202026-03-03T18:55:09.086ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57212026-03-03T18:55:09.086ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57222026-03-03T18:55:09.087ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
57232026-03-03T18:55:09.087ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57242026-03-03T18:55:09.088ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
57252026-03-03T18:55:09.089ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
57262026-03-03T18:55:09.089ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57272026-03-03T18:55:09.089ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57282026-03-03T18:55:09.090ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57292026-03-03T18:55:09.090ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57302026-03-03T18:55:09.090ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57312026-03-03T18:55:09.090ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57322026-03-03T18:55:09.091ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57332026-03-03T18:55:09.094ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57342026-03-03T18:55:09.094ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57352026-03-03T18:55:09.094ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57362026-03-03T18:55:09.094ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57372026-03-03T18:55:09.094ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57382026-03-03T18:55:09.094ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57392026-03-03T18:55:09.096ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57402026-03-03T18:55:09.098ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57412026-03-03T18:55:09.100ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
57422026-03-03T18:55:09.100ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
57432026-03-03T18:55:09.100ZDEBGtest_instance_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57442026-03-03T18:55:09.103ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:09.055855618' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
57452026-03-03T18:55:09.105ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 48762 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bbae7f08-5f84-4c5b-ae8b-9f5a740b07f2 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.055855618Z&order=descending&limit=1
57462026-03-03T18:55:09.105ZINFOtest_instance_metrics (external client test context): client received response status = 200
57472026-03-03T18:55:09.105ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
57482026-03-03T18:55:09.105ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57492026-03-03T18:55:09.105ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57502026-03-03T18:55:09.105ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57512026-03-03T18:55:09.106ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
57522026-03-03T18:55:09.106ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1 version = 2026021900.0.0
57532026-03-03T18:55:09.106ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 7a02fce9-5952-4e1c-bad5-2bbff28bdeac uri = /913233fe-92a8-4635-9572-183f495429c4
57542026-03-03T18:55:09.106ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
57552026-03-03T18:55:09.106ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
57562026-03-03T18:55:09.106ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57572026-03-03T18:55:09.106ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57582026-03-03T18:55:09.107ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57592026-03-03T18:55:09.112ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5650 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 7a02fce9-5952-4e1c-bad5-2bbff28bdeac response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
57602026-03-03T18:55:09.112ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57612026-03-03T18:55:09.118ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57622026-03-03T18:55:09.118ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57632026-03-03T18:55:09.118ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
57642026-03-03T18:55:09.118ZDEBGtest_instance_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57652026-03-03T18:55:09.118ZDEBGtest_instance_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
57662026-03-03T18:55:09.122ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
57672026-03-03T18:55:09.123ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57682026-03-03T18:55:09.123ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57692026-03-03T18:55:09.124ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57702026-03-03T18:55:09.125ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 24 table_name = fields_string
57712026-03-03T18:55:09.125ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
57722026-03-03T18:55:09.126ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
57732026-03-03T18:55:09.126ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
57742026-03-03T18:55:09.126ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57752026-03-03T18:55:09.126ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57762026-03-03T18:55:09.126ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57772026-03-03T18:55:09.127ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 12 table_name = fields_u16
57782026-03-03T18:55:09.127ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
57792026-03-03T18:55:09.127ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57802026-03-03T18:55:09.127ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57812026-03-03T18:55:09.127ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57822026-03-03T18:55:09.128ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57832026-03-03T18:55:09.128ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 12 table_name = fields_uuid
57842026-03-03T18:55:09.128ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
57852026-03-03T18:55:09.129ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
57862026-03-03T18:55:09.131ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
57872026-03-03T18:55:09.131ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57882026-03-03T18:55:09.131ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57892026-03-03T18:55:09.131ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57902026-03-03T18:55:09.132ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
57912026-03-03T18:55:09.132ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
57922026-03-03T18:55:09.132ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57932026-03-03T18:55:09.132ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
57942026-03-03T18:55:09.133ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
57952026-03-03T18:55:09.133ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 12 table_name = measurements_histogramu64
57962026-03-03T18:55:09.133ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
57972026-03-03T18:55:09.134ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
57982026-03-03T18:55:09.134ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
57992026-03-03T18:55:09.134ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58002026-03-03T18:55:09.134ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58012026-03-03T18:55:09.135ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
58022026-03-03T18:55:09.137ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
58032026-03-03T18:55:09.137ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58042026-03-03T18:55:09.137ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58052026-03-03T18:55:09.137ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58062026-03-03T18:55:09.137ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58072026-03-03T18:55:09.137ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58082026-03-03T18:55:09.138ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58092026-03-03T18:55:09.139ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58102026-03-03T18:55:09.142ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58112026-03-03T18:55:09.142ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58122026-03-03T18:55:09.142ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58132026-03-03T18:55:09.142ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58142026-03-03T18:55:09.142ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58152026-03-03T18:55:09.142ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58162026-03-03T18:55:09.143ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58172026-03-03T18:55:09.148ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58182026-03-03T18:55:09.148ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
58192026-03-03T18:55:09.151ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:09.105736988' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
58202026-03-03T18:55:09.152ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 46719 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 4c69ac5d-74ff-4a2f-9fee-753b463755a6 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.105736988Z&order=descending&limit=1
58212026-03-03T18:55:09.153ZINFOtest_instance_metrics (external client test context): client received response status = 200
58222026-03-03T18:55:09.153ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58232026-03-03T18:55:09.153ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58242026-03-03T18:55:09.153ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1 version = 2026021900.0.0
58252026-03-03T18:55:09.153ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58262026-03-03T18:55:09.153ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58272026-03-03T18:55:09.154ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58282026-03-03T18:55:09.154ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58292026-03-03T18:55:09.154ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58302026-03-03T18:55:09.156ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58312026-03-03T18:55:09.156ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58322026-03-03T18:55:09.156ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58332026-03-03T18:55:09.157ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
58342026-03-03T18:55:09.157ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
58352026-03-03T18:55:09.157ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58362026-03-03T18:55:09.157ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58372026-03-03T18:55:09.158ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58382026-03-03T18:55:09.159ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58392026-03-03T18:55:09.159ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58402026-03-03T18:55:09.159ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58412026-03-03T18:55:09.159ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58422026-03-03T18:55:09.160ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
58432026-03-03T18:55:09.162ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
58442026-03-03T18:55:09.162ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58452026-03-03T18:55:09.162ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58462026-03-03T18:55:09.162ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58472026-03-03T18:55:09.163ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
58482026-03-03T18:55:09.163ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
58492026-03-03T18:55:09.163ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58502026-03-03T18:55:09.163ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58512026-03-03T18:55:09.164ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58522026-03-03T18:55:09.164ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58532026-03-03T18:55:09.164ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58542026-03-03T18:55:09.164ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58552026-03-03T18:55:09.165ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58562026-03-03T18:55:09.166ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
58572026-03-03T18:55:09.168ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
58582026-03-03T18:55:09.168ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58592026-03-03T18:55:09.168ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58602026-03-03T18:55:09.168ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58612026-03-03T18:55:09.168ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58622026-03-03T18:55:09.168ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58632026-03-03T18:55:09.168ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58642026-03-03T18:55:09.169ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58652026-03-03T18:55:09.172ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58662026-03-03T18:55:09.172ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58672026-03-03T18:55:09.172ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58682026-03-03T18:55:09.172ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58692026-03-03T18:55:09.172ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58702026-03-03T18:55:09.172ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58712026-03-03T18:55:09.174ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58722026-03-03T18:55:09.176ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58732026-03-03T18:55:09.178ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
58742026-03-03T18:55:09.180ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10733361587332781639) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:09.153489454' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
58752026-03-03T18:55:09.182ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 28763 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d855c167-3714-4e30-8161-cc10e82f1bcb response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.153489454Z&order=descending&limit=1
58762026-03-03T18:55:09.182ZINFOtest_instance_metrics (external client test context): client received response status = 200
58772026-03-03T18:55:09.182ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
58782026-03-03T18:55:09.183ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
58792026-03-03T18:55:09.183ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
58802026-03-03T18:55:09.183ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
58812026-03-03T18:55:09.183ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
58822026-03-03T18:55:09.183ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58832026-03-03T18:55:09.183ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58842026-03-03T18:55:09.183ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58852026-03-03T18:55:09.185ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58862026-03-03T18:55:09.185ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58872026-03-03T18:55:09.185ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58882026-03-03T18:55:09.186ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
58892026-03-03T18:55:09.186ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
58902026-03-03T18:55:09.186ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58912026-03-03T18:55:09.187ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58922026-03-03T18:55:09.187ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58932026-03-03T18:55:09.190ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
58942026-03-03T18:55:09.190ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
58952026-03-03T18:55:09.191ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
58962026-03-03T18:55:09.191ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
58972026-03-03T18:55:09.192ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
58982026-03-03T18:55:09.194ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
58992026-03-03T18:55:09.194ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59002026-03-03T18:55:09.194ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59012026-03-03T18:55:09.195ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59022026-03-03T18:55:09.196ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
59032026-03-03T18:55:09.196ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
59042026-03-03T18:55:09.196ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59052026-03-03T18:55:09.196ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59062026-03-03T18:55:09.196ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59072026-03-03T18:55:09.197ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59082026-03-03T18:55:09.197ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59092026-03-03T18:55:09.197ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59102026-03-03T18:55:09.198ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59112026-03-03T18:55:09.198ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
59122026-03-03T18:55:09.200ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
59132026-03-03T18:55:09.200ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59142026-03-03T18:55:09.200ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59152026-03-03T18:55:09.201ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59162026-03-03T18:55:09.201ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59172026-03-03T18:55:09.201ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59182026-03-03T18:55:09.201ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59192026-03-03T18:55:09.201ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
59202026-03-03T18:55:09.201ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59212026-03-03T18:55:09.201ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59222026-03-03T18:55:09.201ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59232026-03-03T18:55:09.201ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59242026-03-03T18:55:09.202ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59252026-03-03T18:55:09.202ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59262026-03-03T18:55:09.202ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59272026-03-03T18:55:09.202ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59282026-03-03T18:55:09.203ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59292026-03-03T18:55:09.203ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59302026-03-03T18:55:09.203ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59312026-03-03T18:55:09.203ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
59322026-03-03T18:55:09.203ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59332026-03-03T18:55:09.206ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59342026-03-03T18:55:09.206ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59352026-03-03T18:55:09.206ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59362026-03-03T18:55:09.206ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59372026-03-03T18:55:09.207ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59382026-03-03T18:55:09.207ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
59392026-03-03T18:55:09.208ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
59402026-03-03T18:55:09.208ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59412026-03-03T18:55:09.208ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59422026-03-03T18:55:09.208ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59432026-03-03T18:55:09.208ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59442026-03-03T18:55:09.209ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59452026-03-03T18:55:09.210ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
59462026-03-03T18:55:09.210ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
59472026-03-03T18:55:09.210ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59482026-03-03T18:55:09.210ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59492026-03-03T18:55:09.210ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59502026-03-03T18:55:09.211ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59512026-03-03T18:55:09.212ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
59522026-03-03T18:55:09.212ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
59532026-03-03T18:55:09.212ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59542026-03-03T18:55:09.214ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59552026-03-03T18:55:09.214ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59562026-03-03T18:55:09.214ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59572026-03-03T18:55:09.214ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59582026-03-03T18:55:09.214ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59592026-03-03T18:55:09.214ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59602026-03-03T18:55:09.216ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59612026-03-03T18:55:09.219ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59622026-03-03T18:55:09.221ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
59632026-03-03T18:55:09.224ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:09.182895431' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
59642026-03-03T18:55:09.226ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 43080 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 46a37249-e700-403d-a4fb-b2fa45527bea response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.182895431Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59652026-03-03T18:55:09.226ZINFOtest_instance_metrics (external client test context): client received response status = 200
59662026-03-03T18:55:09.226ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59672026-03-03T18:55:09.226ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59682026-03-03T18:55:09.226ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
59692026-03-03T18:55:09.227ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59702026-03-03T18:55:09.227ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
59712026-03-03T18:55:09.227ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59722026-03-03T18:55:09.227ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59732026-03-03T18:55:09.227ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59742026-03-03T18:55:09.229ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59752026-03-03T18:55:09.229ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59762026-03-03T18:55:09.229ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59772026-03-03T18:55:09.231ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
59782026-03-03T18:55:09.231ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
59792026-03-03T18:55:09.231ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59802026-03-03T18:55:09.231ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59812026-03-03T18:55:09.231ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59822026-03-03T18:55:09.232ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59832026-03-03T18:55:09.232ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59842026-03-03T18:55:09.232ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59852026-03-03T18:55:09.233ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59862026-03-03T18:55:09.238ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
59872026-03-03T18:55:09.241ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
59882026-03-03T18:55:09.241ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59892026-03-03T18:55:09.241ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59902026-03-03T18:55:09.241ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59912026-03-03T18:55:09.242ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
59922026-03-03T18:55:09.242ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
59932026-03-03T18:55:09.243ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59942026-03-03T18:55:09.243ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59952026-03-03T18:55:09.243ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
59962026-03-03T18:55:09.244ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
59972026-03-03T18:55:09.244ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
59982026-03-03T18:55:09.244ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
59992026-03-03T18:55:09.245ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60002026-03-03T18:55:09.246ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
60012026-03-03T18:55:09.248ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
60022026-03-03T18:55:09.248ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60032026-03-03T18:55:09.248ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60042026-03-03T18:55:09.248ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60052026-03-03T18:55:09.248ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60062026-03-03T18:55:09.248ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60072026-03-03T18:55:09.248ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60082026-03-03T18:55:09.250ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60092026-03-03T18:55:09.253ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60102026-03-03T18:55:09.255ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60112026-03-03T18:55:09.255ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60122026-03-03T18:55:09.255ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60132026-03-03T18:55:09.255ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60142026-03-03T18:55:09.255ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60152026-03-03T18:55:09.255ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60162026-03-03T18:55:09.255ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60172026-03-03T18:55:09.255ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60182026-03-03T18:55:09.256ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60192026-03-03T18:55:09.257ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60202026-03-03T18:55:09.257ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60212026-03-03T18:55:09.257ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60222026-03-03T18:55:09.258ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60232026-03-03T18:55:09.260ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60242026-03-03T18:55:09.260ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60252026-03-03T18:55:09.260ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60262026-03-03T18:55:09.260ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60272026-03-03T18:55:09.260ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60282026-03-03T18:55:09.260ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60292026-03-03T18:55:09.262ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60302026-03-03T18:55:09.264ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60312026-03-03T18:55:09.266ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
60322026-03-03T18:55:09.269ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:09.226696231' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
60332026-03-03T18:55:09.271ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 44058 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = c3bd0a20-16c7-4f52-94c5-9782a2bfa8a0 response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.226696231Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60342026-03-03T18:55:09.271ZINFOtest_instance_metrics (external client test context): client received response status = 200
60352026-03-03T18:55:09.271ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60362026-03-03T18:55:09.271ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60372026-03-03T18:55:09.271ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
60382026-03-03T18:55:09.271ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60392026-03-03T18:55:09.272ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60402026-03-03T18:55:09.272ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60412026-03-03T18:55:09.272ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60422026-03-03T18:55:09.272ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60432026-03-03T18:55:09.273ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60442026-03-03T18:55:09.274ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60452026-03-03T18:55:09.274ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60462026-03-03T18:55:09.275ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
60472026-03-03T18:55:09.275ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
60482026-03-03T18:55:09.275ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60492026-03-03T18:55:09.275ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60502026-03-03T18:55:09.276ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60512026-03-03T18:55:09.277ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60522026-03-03T18:55:09.277ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60532026-03-03T18:55:09.277ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60542026-03-03T18:55:09.277ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60552026-03-03T18:55:09.278ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
60562026-03-03T18:55:09.280ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
60572026-03-03T18:55:09.280ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60582026-03-03T18:55:09.280ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60592026-03-03T18:55:09.281ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60602026-03-03T18:55:09.282ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
60612026-03-03T18:55:09.282ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
60622026-03-03T18:55:09.282ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60632026-03-03T18:55:09.282ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60642026-03-03T18:55:09.282ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60652026-03-03T18:55:09.283ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
60662026-03-03T18:55:09.283ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
60672026-03-03T18:55:09.283ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
60682026-03-03T18:55:09.284ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
60692026-03-03T18:55:09.284ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
60702026-03-03T18:55:09.286ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
60712026-03-03T18:55:09.286ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60722026-03-03T18:55:09.286ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60732026-03-03T18:55:09.286ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60742026-03-03T18:55:09.286ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60752026-03-03T18:55:09.286ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60762026-03-03T18:55:09.287ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60772026-03-03T18:55:09.294ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60782026-03-03T18:55:09.297ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60792026-03-03T18:55:09.297ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60802026-03-03T18:55:09.297ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60812026-03-03T18:55:09.297ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60822026-03-03T18:55:09.299ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60832026-03-03T18:55:09.299ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60842026-03-03T18:55:09.299ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60852026-03-03T18:55:09.299ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60862026-03-03T18:55:09.299ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60872026-03-03T18:55:09.301ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60882026-03-03T18:55:09.301ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60892026-03-03T18:55:09.301ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60902026-03-03T18:55:09.301ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
60912026-03-03T18:55:09.302ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
60922026-03-03T18:55:09.302ZDEBGtest_instance_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
60932026-03-03T18:55:09.302ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
60942026-03-03T18:55:09.302ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
60952026-03-03T18:55:09.302ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
60962026-03-03T18:55:09.302ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
60972026-03-03T18:55:09.302ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
60982026-03-03T18:55:09.302ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
60992026-03-03T18:55:09.302ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61002026-03-03T18:55:09.302ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61012026-03-03T18:55:09.302ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61022026-03-03T18:55:09.302ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 9425b29d-cbea-4659-90c5-2f9981cb6ce8 uri = /913233fe-92a8-4635-9572-183f495429c4
61032026-03-03T18:55:09.307ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 4329 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 9425b29d-cbea-4659-90c5-2f9981cb6ce8 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
61042026-03-03T18:55:09.307ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61052026-03-03T18:55:09.308ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61062026-03-03T18:55:09.308ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61072026-03-03T18:55:09.309ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61082026-03-03T18:55:09.309ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61092026-03-03T18:55:09.309ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61102026-03-03T18:55:09.309ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61112026-03-03T18:55:09.309ZTRACtest_instance_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61122026-03-03T18:55:09.310ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61132026-03-03T18:55:09.315ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61142026-03-03T18:55:09.315ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61152026-03-03T18:55:09.315ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
61162026-03-03T18:55:09.315ZDEBGtest_instance_metrics (results-sink): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61172026-03-03T18:55:09.316ZDEBGtest_instance_metrics (clickhouse-client): unrolling 12 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
61182026-03-03T18:55:09.320ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 24 sql = INSERT INTO oximeter.fields_string FORMAT Native
61192026-03-03T18:55:09.321ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 24 table_name = fields_string
61202026-03-03T18:55:09.321ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
61212026-03-03T18:55:09.322ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61222026-03-03T18:55:09.325ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61232026-03-03T18:55:09.326ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
61242026-03-03T18:55:09.327ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 12 table_name = fields_u16
61252026-03-03T18:55:09.327ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 12 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
61262026-03-03T18:55:09.328ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 12 table_name = fields_uuid
61272026-03-03T18:55:09.328ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 12 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
61282026-03-03T18:55:09.329ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:09.271485633' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
61292026-03-03T18:55:09.330ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 59221 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 430c15dd-bb79-4a27-9046-405e08680617 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:09.271485633Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
61302026-03-03T18:55:09.331ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 12 table_name = measurements_histogramu64
61312026-03-03T18:55:09.331ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
61322026-03-03T18:55:09.331ZINFOtest_instance_metrics (external client test context): client received response status = 200
61332026-03-03T18:55:09.331ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/instances?project=springfield-squidport
61342026-03-03T18:55:09.332ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 uri = /v1/instances?project=springfield-squidport
61352026-03-03T18:55:09.332ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 uri = /v1/instances?project=springfield-squidport version = 2026021900.0.0
61362026-03-03T18:55:09.332ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 uri = /v1/instances?project=springfield-squidport
61372026-03-03T18:55:09.332ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances?project=springfield-squidport
61382026-03-03T18:55:09.332ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61392026-03-03T18:55:09.332ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61402026-03-03T18:55:09.333ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61412026-03-03T18:55:09.334ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61422026-03-03T18:55:09.334ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61432026-03-03T18:55:09.335ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61442026-03-03T18:55:09.336ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
61452026-03-03T18:55:09.336ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
61462026-03-03T18:55:09.336ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61472026-03-03T18:55:09.336ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61482026-03-03T18:55:09.337ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61492026-03-03T18:55:09.338ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61502026-03-03T18:55:09.338ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61512026-03-03T18:55:09.338ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61522026-03-03T18:55:09.338ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61532026-03-03T18:55:09.339ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
61542026-03-03T18:55:09.341ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
61552026-03-03T18:55:09.341ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61562026-03-03T18:55:09.341ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61572026-03-03T18:55:09.341ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61582026-03-03T18:55:09.342ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
61592026-03-03T18:55:09.342ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
61602026-03-03T18:55:09.342ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61612026-03-03T18:55:09.342ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61622026-03-03T18:55:09.343ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61632026-03-03T18:55:09.343ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
61642026-03-03T18:55:09.343ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
61652026-03-03T18:55:09.343ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
61662026-03-03T18:55:09.344ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
61672026-03-03T18:55:09.345ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
61682026-03-03T18:55:09.346ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
61692026-03-03T18:55:09.346ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 uri = /v1/instances?project=springfield-squidport
61702026-03-03T18:55:09.346ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61712026-03-03T18:55:09.346ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61722026-03-03T18:55:09.347ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61732026-03-03T18:55:09.347ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61742026-03-03T18:55:09.347ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61752026-03-03T18:55:09.348ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61762026-03-03T18:55:09.349ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61772026-03-03T18:55:09.350ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61782026-03-03T18:55:09.350ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61792026-03-03T18:55:09.350ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61802026-03-03T18:55:09.351ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61812026-03-03T18:55:09.351ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61822026-03-03T18:55:09.352ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61832026-03-03T18:55:09.353ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61842026-03-03T18:55:09.353ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61852026-03-03T18:55:09.353ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61862026-03-03T18:55:09.355ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61872026-03-03T18:55:09.355ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61882026-03-03T18:55:09.355ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61892026-03-03T18:55:09.355ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61902026-03-03T18:55:09.355ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61912026-03-03T18:55:09.356ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61922026-03-03T18:55:09.356ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61932026-03-03T18:55:09.357ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61942026-03-03T18:55:09.357ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61952026-03-03T18:55:09.358ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61962026-03-03T18:55:09.358ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61972026-03-03T18:55:09.358ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61982026-03-03T18:55:09.359ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
61992026-03-03T18:55:09.360ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62002026-03-03T18:55:09.364ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62012026-03-03T18:55:09.364ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62022026-03-03T18:55:09.364ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62032026-03-03T18:55:09.364ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62042026-03-03T18:55:09.365ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62052026-03-03T18:55:09.365ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62062026-03-03T18:55:09.365ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62072026-03-03T18:55:09.366ZTRACtest_instance_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62082026-03-03T18:55:09.366ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62092026-03-03T18:55:09.367ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62102026-03-03T18:55:09.367ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62112026-03-03T18:55:09.367ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62122026-03-03T18:55:09.368ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62132026-03-03T18:55:09.368ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62142026-03-03T18:55:09.368ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62152026-03-03T18:55:09.369ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62162026-03-03T18:55:09.370ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62172026-03-03T18:55:09.372ZDEBGtest_instance_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62182026-03-03T18:55:09.372ZTRACtest_instance_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62192026-03-03T18:55:09.372ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62202026-03-03T18:55:09.372ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62212026-03-03T18:55:09.372ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62222026-03-03T18:55:09.372ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62232026-03-03T18:55:09.373ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62242026-03-03T18:55:09.374ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62252026-03-03T18:55:09.374ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62262026-03-03T18:55:09.374ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62272026-03-03T18:55:09.375ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62282026-03-03T18:55:09.377ZDEBGtest_instance_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62292026-03-03T18:55:09.377ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62302026-03-03T18:55:09.377ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62312026-03-03T18:55:09.377ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62322026-03-03T18:55:09.388ZTRACtest_instance_metrics (dropshot_external): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62332026-03-03T18:55:09.388ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62342026-03-03T18:55:09.388ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62352026-03-03T18:55:09.388ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62362026-03-03T18:55:09.389ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62372026-03-03T18:55:09.392ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62382026-03-03T18:55:09.392ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62392026-03-03T18:55:09.392ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62402026-03-03T18:55:09.393ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62412026-03-03T18:55:09.394ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62422026-03-03T18:55:09.394ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62432026-03-03T18:55:09.394ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62442026-03-03T18:55:09.395ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62452026-03-03T18:55:09.396ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62462026-03-03T18:55:09.400ZDEBGtest_instance_metrics (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62472026-03-03T18:55:09.401ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62482026-03-03T18:55:09.401ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62492026-03-03T18:55:09.401ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
62502026-03-03T18:55:09.403ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
62512026-03-03T18:55:09.403ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
62522026-03-03T18:55:09.403ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62532026-03-03T18:55:09.403ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62542026-03-03T18:55:09.403ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62552026-03-03T18:55:09.403ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62562026-03-03T18:55:09.403ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62572026-03-03T18:55:09.403ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62582026-03-03T18:55:09.404ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
62592026-03-03T18:55:09.404ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
62602026-03-03T18:55:09.404ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
62612026-03-03T18:55:09.404ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
62622026-03-03T18:55:09.405ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
62632026-03-03T18:55:09.405ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62642026-03-03T18:55:09.406ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62652026-03-03T18:55:09.406ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62662026-03-03T18:55:09.406ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62672026-03-03T18:55:09.406ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62682026-03-03T18:55:09.407ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
62692026-03-03T18:55:09.409ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
62702026-03-03T18:55:09.409ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
62712026-03-03T18:55:09.409ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
62722026-03-03T18:55:09.409ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
62732026-03-03T18:55:09.410ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62742026-03-03T18:55:09.410ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62752026-03-03T18:55:09.410ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62762026-03-03T18:55:09.410ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
62772026-03-03T18:55:09.415ZINFOtest_instance_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
62782026-03-03T18:55:09.415ZINFOtest_instance_metrics (SagaExecutor): preparing saga saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create
62792026-03-03T18:55:09.415ZINFOtest_instance_metrics (SEC): saga create dag = {"end_node":12,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[11,0,null],[10,12,null]],"node_holes":[],"nodes":[{"Constant":{"name":"instance_id","value":"62af126f-88fe-4275-b8a4-75b87584f9b2"}},{"Action":{"action_name":"instance_create.create_instance_record","label":"CreateInstanceRecord","name":"instance_record"}},{"Action":{"action_name":"instance_create.associate_ssh_keys","label":"AssociateSshKeys","name":"output"}},{"Constant":{"name":"network_interface_params0","value":{"instance_id":"62af126f-88fe-4275-b8a4-75b87584f9b2","instance_name":"just-rainsticks","interface_id":"08bb2f95-b0bf-4966-80c9-3dce6987404e","nic_spec":{"Default":"Ipv4"},"project_id":"f04dd7b1-f806-4002-8222-cf99123d65c7","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},{"SubsagaStart":{"params_node_name":"network_interface_params0","saga_name":"instance-create-nic0"}},{"Action":{"action_name":"instance_create.create_network_interface","label":"CreateNetworkInterface0","name":"output"}},{"SubsagaEnd":{"name":"network_interface0"}},{"Action":{"action_name":"common.uuid_generate","label":"CreateSnatIpv4Id","name":"snat_ipv4_id"}},{"Action":{"action_name":"instance_create.create_snat_ipv4","label":"CreateSnatIpv4","name":"snat_ipv4"}},{"Action":{"action_name":"instance_create.set_boot_disk","label":"SetBootDisk","name":"set_boot_disk"}},{"Action":{"action_name":"instance_create.move_to_stopped","label":"MoveToStopped","name":"stopped_instance"}},{"Start":{"params":{"boundary_switches":[],"create_params":{"anti_affinity_groups":[],"auto_restart_policy":null,"boot_disk":null,"cpu_platform":null,"description":"instance \\"just-rainsticks\\"","disks":[],"external_ips":[],"hostname":"the-host","memory":1073741824,"multicast_groups":[],"name":"just-rainsticks","ncpus":4,"network_interfaces":{"type":"default_ipv4"},"ssh_public_keys":[],"start":true,"user_data":"I2Nsb3VkLWNvbmZpZwpzeXN0ZW1faW5mbzoKICBkZWZhdWx0X3VzZXI6CiAgICBuYW1lOiBveGlkZQ=="},"project_id":"f04dd7b1-f806-4002-8222-cf99123d65c7","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-create","start_node":11} saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
62802026-03-03T18:55:09.415ZINFOtest_instance_metrics (SecStore): creating saga saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create
62812026-03-03T18:55:09.417ZINFOtest_instance_metrics (SagaExecutor): starting saga saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create
62822026-03-03T18:55:09.417ZINFOtest_instance_metrics (SEC): saga start saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
62832026-03-03T18:55:09.417ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
62842026-03-03T18:55:09.417ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
62852026-03-03T18:55:09.418ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
62862026-03-03T18:55:09.418ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
62872026-03-03T18:55:09.419ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
62882026-03-03T18:55:09.419ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
62892026-03-03T18:55:09.420ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
62902026-03-03T18:55:09.420ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("62af126f-88fe-4275-b8a4-75b87584f9b2")) node_id = 0 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
62912026-03-03T18:55:09.421ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
62922026-03-03T18:55:09.421ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
62932026-03-03T18:55:09.423ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
62942026-03-03T18:55:09.423ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
62952026-03-03T18:55:09.423ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
62962026-03-03T18:55:09.424ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
62972026-03-03T18:55:09.424ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
62982026-03-03T18:55:09.425ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
62992026-03-03T18:55:09.426ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63002026-03-03T18:55:09.426ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63012026-03-03T18:55:09.426ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63022026-03-03T18:55:09.426ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63032026-03-03T18:55:09.426ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63042026-03-03T18:55:09.428ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63052026-03-03T18:55:09.428ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63062026-03-03T18:55:09.428ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63072026-03-03T18:55:09.428ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63082026-03-03T18:55:09.430ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63092026-03-03T18:55:09.430ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63102026-03-03T18:55:09.430ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63112026-03-03T18:55:09.430ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63122026-03-03T18:55:09.431ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63132026-03-03T18:55:09.435ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63142026-03-03T18:55:09.435ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63152026-03-03T18:55:09.435ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63162026-03-03T18:55:09.435ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63172026-03-03T18:55:09.435ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63182026-03-03T18:55:09.435ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63192026-03-03T18:55:09.437ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63202026-03-03T18:55:09.437ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63212026-03-03T18:55:09.437ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63222026-03-03T18:55:09.437ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63232026-03-03T18:55:09.439ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63242026-03-03T18:55:09.439ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63252026-03-03T18:55:09.439ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63262026-03-03T18:55:09.439ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63272026-03-03T18:55:09.440ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63282026-03-03T18:55:09.444ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63292026-03-03T18:55:09.444ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63302026-03-03T18:55:09.444ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63312026-03-03T18:55:09.444ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateInstanceRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63322026-03-03T18:55:09.496ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
63332026-03-03T18:55:09.497ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"just-rainsticks\\""), "id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "name": String("just-rainsticks"), "time_created": String("2026-03-03T18:55:09.423319Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:09.423319Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:55:09.423319Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}) node_id = 1 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63342026-03-03T18:55:09.498ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
63352026-03-03T18:55:09.498ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63362026-03-03T18:55:09.500ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63372026-03-03T18:55:09.500ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63382026-03-03T18:55:09.501ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63392026-03-03T18:55:09.502ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63402026-03-03T18:55:09.502ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63412026-03-03T18:55:09.502ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63422026-03-03T18:55:09.504ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63432026-03-03T18:55:09.504ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63442026-03-03T18:55:09.504ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63452026-03-03T18:55:09.504ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63462026-03-03T18:55:09.504ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63472026-03-03T18:55:09.504ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
63482026-03-03T18:55:09.505ZTRACtest_instance_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63492026-03-03T18:55:09.505ZDEBGtest_instance_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
63502026-03-03T18:55:09.506ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63512026-03-03T18:55:09.506ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63522026-03-03T18:55:09.506ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63532026-03-03T18:55:09.506ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63542026-03-03T18:55:09.508ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63552026-03-03T18:55:09.509ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63562026-03-03T18:55:09.509ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63572026-03-03T18:55:09.509ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63582026-03-03T18:55:09.509ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63592026-03-03T18:55:09.510ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63602026-03-03T18:55:09.510ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63612026-03-03T18:55:09.511ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63622026-03-03T18:55:09.511ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63632026-03-03T18:55:09.511ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63642026-03-03T18:55:09.518ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63652026-03-03T18:55:09.518ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63662026-03-03T18:55:09.518ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = AssociateSshKeys silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63672026-03-03T18:55:09.518ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
63682026-03-03T18:55:09.518ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63692026-03-03T18:55:09.522ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
63702026-03-03T18:55:09.522ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63712026-03-03T18:55:09.523ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
63722026-03-03T18:55:09.523ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "instance_name": String("just-rainsticks"), "interface_id": String("08bb2f95-b0bf-4966-80c9-3dce6987404e"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}) node_id = 3 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63732026-03-03T18:55:09.525ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
63742026-03-03T18:55:09.525ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63752026-03-03T18:55:09.526ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
63762026-03-03T18:55:09.526ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63772026-03-03T18:55:09.528ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
63782026-03-03T18:55:09.528ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
63792026-03-03T18:55:09.529ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63802026-03-03T18:55:09.529ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63812026-03-03T18:55:09.529ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63822026-03-03T18:55:09.531ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63832026-03-03T18:55:09.531ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63842026-03-03T18:55:09.532ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63852026-03-03T18:55:09.533ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63862026-03-03T18:55:09.533ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63872026-03-03T18:55:09.533ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63882026-03-03T18:55:09.534ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63892026-03-03T18:55:09.534ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63902026-03-03T18:55:09.534ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63912026-03-03T18:55:09.534ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63922026-03-03T18:55:09.534ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63932026-03-03T18:55:09.536ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63942026-03-03T18:55:09.536ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63952026-03-03T18:55:09.536ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63962026-03-03T18:55:09.536ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63972026-03-03T18:55:09.546ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63982026-03-03T18:55:09.546ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
63992026-03-03T18:55:09.546ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64002026-03-03T18:55:09.547ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64012026-03-03T18:55:09.548ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64022026-03-03T18:55:09.552ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64032026-03-03T18:55:09.553ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64042026-03-03T18:55:09.553ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64052026-03-03T18:55:09.553ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64062026-03-03T18:55:09.554ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64072026-03-03T18:55:09.554ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64082026-03-03T18:55:09.555ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64092026-03-03T18:55:09.556ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64102026-03-03T18:55:09.556ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64112026-03-03T18:55:09.556ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64122026-03-03T18:55:09.557ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64132026-03-03T18:55:09.557ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64142026-03-03T18:55:09.558ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64152026-03-03T18:55:09.559ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ByName("default") } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64162026-03-03T18:55:09.559ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64172026-03-03T18:55:09.559ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64182026-03-03T18:55:09.559ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64192026-03-03T18:55:09.559ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64202026-03-03T18:55:09.561ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64212026-03-03T18:55:09.561ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64222026-03-03T18:55:09.561ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64232026-03-03T18:55:09.561ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64242026-03-03T18:55:09.563ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64252026-03-03T18:55:09.563ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64262026-03-03T18:55:09.563ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64272026-03-03T18:55:09.563ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64282026-03-03T18:55:09.565ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64292026-03-03T18:55:09.570ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ByName("default") } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64302026-03-03T18:55:09.570ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64312026-03-03T18:55:09.570ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64322026-03-03T18:55:09.570ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64332026-03-03T18:55:09.570ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64342026-03-03T18:55:09.571ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64352026-03-03T18:55:09.572ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64362026-03-03T18:55:09.572ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64372026-03-03T18:55:09.572ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64382026-03-03T18:55:09.573ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64392026-03-03T18:55:09.574ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64402026-03-03T18:55:09.574ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64412026-03-03T18:55:09.574ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64422026-03-03T18:55:09.575ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64432026-03-03T18:55:09.576ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64442026-03-03T18:55:09.580ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64452026-03-03T18:55:09.580ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ByName("default") } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64462026-03-03T18:55:09.580ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64472026-03-03T18:55:09.581ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64482026-03-03T18:55:09.581ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64492026-03-03T18:55:09.581ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64502026-03-03T18:55:09.583ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64512026-03-03T18:55:09.583ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64522026-03-03T18:55:09.583ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64532026-03-03T18:55:09.583ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64542026-03-03T18:55:09.585ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64552026-03-03T18:55:09.585ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64562026-03-03T18:55:09.585ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64572026-03-03T18:55:09.586ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64582026-03-03T18:55:09.587ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64592026-03-03T18:55:09.593ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ByName("default") } result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64602026-03-03T18:55:09.593ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64612026-03-03T18:55:09.593ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64622026-03-03T18:55:09.593ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64632026-03-03T18:55:09.606ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
64642026-03-03T18:55:09.606ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64652026-03-03T18:55:09.606ZDEBGtest_instance_metrics (results-sink): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64662026-03-03T18:55:09.607ZDEBGtest_instance_metrics (clickhouse-client): unrolling 2 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
64672026-03-03T18:55:09.608ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
64682026-03-03T18:55:09.614ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
64692026-03-03T18:55:09.614ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
64702026-03-03T18:55:09.619ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = measurements_i64
64712026-03-03T18:55:09.619ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64722026-03-03T18:55:09.652ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64732026-03-03T18:55:09.652ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64742026-03-03T18:55:09.652ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateNetworkInterface0 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64752026-03-03T18:55:09.653ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
64762026-03-03T18:55:09.653ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64772026-03-03T18:55:09.655ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
64782026-03-03T18:55:09.655ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64792026-03-03T18:55:09.661ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
64802026-03-03T18:55:09.661ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64812026-03-03T18:55:09.664ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
64822026-03-03T18:55:09.664ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64832026-03-03T18:55:09.665ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
64842026-03-03T18:55:09.665ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("1463cc53-f082-41eb-9f15-9188c1f7ae53")) node_id = 7 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64852026-03-03T18:55:09.667ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
64862026-03-03T18:55:09.667ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64872026-03-03T18:55:09.669ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64882026-03-03T18:55:09.669ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64892026-03-03T18:55:09.669ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64902026-03-03T18:55:09.672ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64912026-03-03T18:55:09.672ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64922026-03-03T18:55:09.672ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_node = CreateSnatIpv4 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
64932026-03-03T18:55:09.715ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
64942026-03-03T18:55:09.715ZDEBGtest_instance_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
64952026-03-03T18:55:09.797ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
64962026-03-03T18:55:09.797ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64972026-03-03T18:55:09.800ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
64982026-03-03T18:55:09.800ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
64992026-03-03T18:55:09.802ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
65002026-03-03T18:55:09.802ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65012026-03-03T18:55:09.804ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
65022026-03-03T18:55:09.804ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65032026-03-03T18:55:09.808ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
65042026-03-03T18:55:09.808ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65052026-03-03T18:55:09.832ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
65062026-03-03T18:55:09.832ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65072026-03-03T18:55:09.834ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
65082026-03-03T18:55:09.834ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65092026-03-03T18:55:09.836ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
65102026-03-03T18:55:09.836ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65112026-03-03T18:55:09.837ZINFOtest_instance_metrics (SEC): update for saga cached state new_state = Done saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed sec_id = 913233fe-92a8-4635-9572-183f495429c4
65122026-03-03T18:55:09.837ZINFOtest_instance_metrics (SecStore): updating state new_state = done saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65132026-03-03T18:55:09.847ZINFOtest_instance_metrics (SEC): saga finished result = success saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create sec_id = 913233fe-92a8-4635-9572-183f495429c4
65142026-03-03T18:55:09.847ZINFOtest_instance_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed
65152026-03-03T18:55:09.847ZINFOtest_instance_metrics (SagaExecutor): saga finished saga_id = 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed saga_name = instance-create saga_result = SagaResult { saga_id: 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed, saga_log: SagaLog { saga_id: 0e7fdfa7-b3d2-4186-8f83-373bb6ca08ed, unwinding: false, events: [N011 started, N011 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N012 started, N012 succeeded], node_status: {0: Succeeded(String("62af126f-88fe-4275-b8a4-75b87584f9b2")), 1: Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"just-rainsticks\\""), "id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "name": String("just-rainsticks"), "time_created": String("2026-03-03T18:55:09.423319Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:09.423319Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:55:09.423319Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}), 2: Succeeded(Null), 3: Succeeded(Object {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "instance_name": String("just-rainsticks"), "interface_id": String("08bb2f95-b0bf-4966-80c9-3dce6987404e"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(String("1463cc53-f082-41eb-9f15-9188c1f7ae53")), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "instance_record": Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"just-rainsticks\\""), "id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "name": String("just-rainsticks"), "time_created": String("2026-03-03T18:55:09.423319Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:09.423319Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(1), "migration_id": Null, "nexus_state": String("Creating"), "propolis_id": Null, "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:55:09.423319Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}, "network_interface0": Null, "network_interface_params0": Object {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "instance_name": String("just-rainsticks"), "interface_id": String("08bb2f95-b0bf-4966-80c9-3dce6987404e"), "nic_spec": Object {"Default": String("Ipv4")}, "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("001de000-5110-4000-8000-000000000000"), "silo_user_id": String("001de000-05e4-4000-8000-000000004007")}}, "credential_id": Null, "device_token_expiration": Null}, Object {"mapped_fleet_roles": Object {}}]}}}, "output": Null, "set_boot_disk": Null, "snat_ipv4": Null, "snat_ipv4_id": String("1463cc53-f082-41eb-9f15-9188c1f7ae53"), "stopped_instance": Null} }) }
65162026-03-03T18:55:09.848ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65172026-03-03T18:55:09.848ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65182026-03-03T18:55:09.848ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65192026-03-03T18:55:09.861ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65202026-03-03T18:55:09.861ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65212026-03-03T18:55:09.862ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65222026-03-03T18:55:09.870ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65232026-03-03T18:55:09.870ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65242026-03-03T18:55:09.871ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65252026-03-03T18:55:09.874ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65262026-03-03T18:55:09.874ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65272026-03-03T18:55:09.874ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65282026-03-03T18:55:09.874ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65292026-03-03T18:55:09.874ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65302026-03-03T18:55:09.876ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65312026-03-03T18:55:09.878ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65322026-03-03T18:55:09.878ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65332026-03-03T18:55:09.878ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65342026-03-03T18:55:09.880ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65352026-03-03T18:55:09.880ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65362026-03-03T18:55:09.880ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65372026-03-03T18:55:09.880ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65382026-03-03T18:55:09.882ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65392026-03-03T18:55:09.887ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65402026-03-03T18:55:09.887ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65412026-03-03T18:55:09.887ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65422026-03-03T18:55:09.887ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65432026-03-03T18:55:09.887ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65442026-03-03T18:55:09.891ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65452026-03-03T18:55:09.894ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65462026-03-03T18:55:09.894ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65472026-03-03T18:55:09.894ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65482026-03-03T18:55:09.894ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65492026-03-03T18:55:09.896ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65502026-03-03T18:55:09.896ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65512026-03-03T18:55:09.896ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65522026-03-03T18:55:09.897ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65532026-03-03T18:55:09.899ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65542026-03-03T18:55:09.904ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65552026-03-03T18:55:09.904ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65562026-03-03T18:55:09.904ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65572026-03-03T18:55:09.905ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65582026-03-03T18:55:09.907ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65592026-03-03T18:55:09.908ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65602026-03-03T18:55:09.908ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65612026-03-03T18:55:09.908ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65622026-03-03T18:55:09.908ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65632026-03-03T18:55:09.918ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
65642026-03-03T18:55:09.918ZDEBGtest_instance_metrics (results-sink-cluster): inserting 11 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
65652026-03-03T18:55:09.921ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65662026-03-03T18:55:09.921ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65672026-03-03T18:55:09.921ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65682026-03-03T18:55:09.921ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65692026-03-03T18:55:09.925ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65702026-03-03T18:55:09.925ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65712026-03-03T18:55:09.925ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65722026-03-03T18:55:09.926ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65732026-03-03T18:55:09.933ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65742026-03-03T18:55:09.935ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65752026-03-03T18:55:09.980ZINFOtest_instance_metrics (dropshot_external): set intended instance state authenticated = true changed = false instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 intended_state = running local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
65762026-03-03T18:55:09.980ZINFOtest_instance_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
65772026-03-03T18:55:09.980ZINFOtest_instance_metrics (SagaExecutor): preparing saga saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start
65782026-03-03T18:55:09.980ZINFOtest_instance_metrics (SEC): saga create dag = {"end_node":25,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[5,7,null],[5,8,null],[5,9,null],[5,10,null],[5,11,null],[5,12,null],[5,13,null],[5,14,null],[5,15,null],[5,16,null],[5,17,null],[6,18,null],[7,18,null],[8,18,null],[9,18,null],[10,18,null],[11,18,null],[12,18,null],[13,18,null],[14,18,null],[15,18,null],[16,18,null],[17,18,null],[18,19,null],[19,20,null],[20,21,null],[21,22,null],[22,23,null],[24,0,null],[23,25,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_start.generate_propolis_id","label":"GeneratePropolisId","name":"propolis_id"}},{"Action":{"action_name":"instance_start.alloc_server","label":"AllocServer","name":"sled_id"}},{"Action":{"action_name":"instance_start.alloc_propolis_ip","label":"AllocPropolisIp","name":"propolis_ip"}},{"Action":{"action_name":"instance_start.create_vmm_record","label":"CreateVmmRecord","name":"vmm_record"}},{"Action":{"action_name":"instance_start.mark_as_starting","label":"MarkAsStarting","name":"started_record"}},{"Action":{"action_name":"instance_start.list_local_storage","label":"ListLocalStorage","name":"local_storage_records"}},{"Action":{"action_name":"instance_start.ensure_local_storage_0","label":"EnsureLocalStorage_0","name":"ensure_local_storage_0"}},{"Action":{"action_name":"instance_start.ensure_local_storage_1","label":"EnsureLocalStorage_1","name":"ensure_local_storage_1"}},{"Action":{"action_name":"instance_start.ensure_local_storage_2","label":"EnsureLocalStorage_2","name":"ensure_local_storage_2"}},{"Action":{"action_name":"instance_start.ensure_local_storage_3","label":"EnsureLocalStorage_3","name":"ensure_local_storage_3"}},{"Action":{"action_name":"instance_start.ensure_local_storage_4","label":"EnsureLocalStorage_4","name":"ensure_local_storage_4"}},{"Action":{"action_name":"instance_start.ensure_local_storage_5","label":"EnsureLocalStorage_5","name":"ensure_local_storage_5"}},{"Action":{"action_name":"instance_start.ensure_local_storage_6","label":"EnsureLocalStorage_6","name":"ensure_local_storage_6"}},{"Action":{"action_name":"instance_start.ensure_local_storage_7","label":"EnsureLocalStorage_7","name":"ensure_local_storage_7"}},{"Action":{"action_name":"instance_start.ensure_local_storage_8","label":"EnsureLocalStorage_8","name":"ensure_local_storage_8"}},{"Action":{"action_name":"instance_start.ensure_local_storage_9","label":"EnsureLocalStorage_9","name":"ensure_local_storage_9"}},{"Action":{"action_name":"instance_start.ensure_local_storage_10","label":"EnsureLocalStorage_10","name":"ensure_local_storage_10"}},{"Action":{"action_name":"instance_start.ensure_local_storage_11","label":"EnsureLocalStorage_11","name":"ensure_local_storage_11"}},{"Action":{"action_name":"instance_start.dpd_ensure","label":"DpdEnsure","name":"dpd_ensure"}},{"Action":{"action_name":"instance_start.v2p_ensure","label":"V2PEnsure","name":"v2p_ensure"}},{"Action":{"action_name":"instance_start.ensure_registered","label":"EnsureRegistered","name":"ensure_registered"}},{"Action":{"action_name":"instance_start.update_multicast_sled_id","label":"UpdateMulticastSledId","name":"multicast_sled_id"}},{"Action":{"action_name":"instance_start.add_virtual_resources","label":"AddVirtualResources","name":"virtual_resources"}},{"Action":{"action_name":"instance_start.ensure_running","label":"EnsureRunning","name":"ensure_running"}},{"Start":{"params":{"db_instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":null,"cpu_platform":null,"hostname":"the-host","identity":{"description":"instance \\"just-rainsticks\\"","id":"62af126f-88fe-4275-b8a4-75b87584f9b2","name":"just-rainsticks","time_created":"2026-03-03T18:55:09.423319Z","time_deleted":null,"time_modified":"2026-03-03T18:55:09.423319Z"},"intended_state":"Running","memory":1073741824,"ncpus":4,"project_id":"f04dd7b1-f806-4002-8222-cf99123d65c7","runtime_state":{"dst_propolis_id":null,"gen":2,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2026-03-03T18:55:09.423319Z"},"updater_gen":1,"updater_id":null,"user_data":[35,99,108,111,117,100,45,99,111,110,102,105,103,10,115,121,115,116,101,109,95,105,110,102,111,58,10,32,32,100,101,102,97,117,108,116,95,117,115,101,114,58,10,32,32,32,32,110,97,109,101,58,32,111,120,105,100,101]},"reason":"AutoStart","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-start","start_node":24} saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
65792026-03-03T18:55:09.980ZINFOtest_instance_metrics (SecStore): creating saga saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start
65802026-03-03T18:55:09.985ZINFOtest_instance_metrics (SagaExecutor): starting saga saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start
65812026-03-03T18:55:09.985ZINFOtest_instance_metrics (SEC): saga start saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
65822026-03-03T18:55:09.985ZDEBGtest_instance_metrics (SEC): saga log event new_state = N024 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
65832026-03-03T18:55:09.985ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 24 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
65842026-03-03T18:55:09.987ZDEBGtest_instance_metrics (SEC): saga log event new_state = N024 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
65852026-03-03T18:55:09.987ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 24 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
65862026-03-03T18:55:09.988ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
65872026-03-03T18:55:09.990ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
65882026-03-03T18:55:09.990ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
65892026-03-03T18:55:09.990ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("4b5695ce-ffd0-4755-b762-191fd8be0384")) node_id = 0 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
65902026-03-03T18:55:09.991ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
65912026-03-03T18:55:09.991ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
65922026-03-03T18:55:09.993ZINFOtest_instance_metrics (InstanceAllocator): sled reservation starting instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
65932026-03-03T18:55:09.993ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
65942026-03-03T18:55:09.993ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
65952026-03-03T18:55:09.993ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
65962026-03-03T18:55:09.999ZINFOtest_instance_metrics (InstanceAllocator): no attached local storage disks instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
65972026-03-03T18:55:10.007ZINFOtest_instance_metrics (InstanceAllocator): sled targets: {b6d65341-167c-41df-9b5c-41cded99c229 (sled)} instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
65982026-03-03T18:55:10.007ZINFOtest_instance_metrics (InstanceAllocator): local_storage_allocation_required: false instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
65992026-03-03T18:55:10.007ZINFOtest_instance_metrics (InstanceAllocator): trying sled target b6d65341-167c-41df-9b5c-41cded99c229 instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
66002026-03-03T18:55:10.007ZINFOtest_instance_metrics (InstanceAllocator): attempting to insert sled resource record instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 local_storage_required = false propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
66012026-03-03T18:55:10.012ZINFOtest_instance_metrics (InstanceAllocator): reservation succeeded! instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 query = sled_reservation
66022026-03-03T18:55:10.012ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
66032026-03-03T18:55:10.012ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("b6d65341-167c-41df-9b5c-41cded99c229")) node_id = 1 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66042026-03-03T18:55:10.017ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
66052026-03-03T18:55:10.017ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66062026-03-03T18:55:10.017ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66072026-03-03T18:55:10.017ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66082026-03-03T18:55:10.017ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = AllocPropolisIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66092026-03-03T18:55:10.020ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
66102026-03-03T18:55:10.020ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66112026-03-03T18:55:10.020ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
66122026-03-03T18:55:10.020ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("::1:0")) node_id = 2 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66132026-03-03T18:55:10.021ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
66142026-03-03T18:55:10.021ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66152026-03-03T18:55:10.025ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
66162026-03-03T18:55:10.025ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
66172026-03-03T18:55:10.025ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
66182026-03-03T18:55:10.025ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
66192026-03-03T18:55:10.025ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
66202026-03-03T18:55:10.025ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
66212026-03-03T18:55:10.025ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
66222026-03-03T18:55:10.025ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
66232026-03-03T18:55:10.030ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
66242026-03-03T18:55:10.033ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
66252026-03-03T18:55:10.033ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66262026-03-03T18:55:10.033ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66272026-03-03T18:55:10.033ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = CreateVmmRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66282026-03-03T18:55:10.105ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
66292026-03-03T18:55:10.105ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T18:55:10.033378Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:55:10.033378Z"), "time_deleted": Null}) node_id = 3 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66302026-03-03T18:55:10.107ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
66312026-03-03T18:55:10.108ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66322026-03-03T18:55:10.109ZINFOtest_instance_metrics (SagaExecutor): moving instance to Starting state via saga instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start start_reason = AutoStart
66332026-03-03T18:55:10.109ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66342026-03-03T18:55:10.109ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66352026-03-03T18:55:10.110ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66362026-03-03T18:55:10.112ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66372026-03-03T18:55:10.112ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66382026-03-03T18:55:10.112ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66392026-03-03T18:55:10.113ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66402026-03-03T18:55:10.113ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66412026-03-03T18:55:10.114ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66422026-03-03T18:55:10.115ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66432026-03-03T18:55:10.115ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66442026-03-03T18:55:10.115ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66452026-03-03T18:55:10.115ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66462026-03-03T18:55:10.116ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66472026-03-03T18:55:10.117ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66482026-03-03T18:55:10.118ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66492026-03-03T18:55:10.118ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66502026-03-03T18:55:10.118ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66512026-03-03T18:55:10.119ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66522026-03-03T18:55:10.119ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66532026-03-03T18:55:10.119ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66542026-03-03T18:55:10.120ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66552026-03-03T18:55:10.120ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
66562026-03-03T18:55:10.120ZDEBGtest_instance_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
66572026-03-03T18:55:10.121ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66582026-03-03T18:55:10.126ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66592026-03-03T18:55:10.126ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66602026-03-03T18:55:10.126ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66612026-03-03T18:55:10.126ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66622026-03-03T18:55:10.126ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66632026-03-03T18:55:10.126ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66642026-03-03T18:55:10.130ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66652026-03-03T18:55:10.130ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66662026-03-03T18:55:10.130ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66672026-03-03T18:55:10.130ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66682026-03-03T18:55:10.132ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66692026-03-03T18:55:10.132ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66702026-03-03T18:55:10.132ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66712026-03-03T18:55:10.132ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66722026-03-03T18:55:10.144ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66732026-03-03T18:55:10.150ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66742026-03-03T18:55:10.150ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66752026-03-03T18:55:10.150ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66762026-03-03T18:55:10.150ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = MarkAsStarting silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66772026-03-03T18:55:10.159ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
66782026-03-03T18:55:10.159ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"just-rainsticks\\""), "id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "name": String("just-rainsticks"), "time_created": String("2026-03-03T18:55:09.423319Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:09.423319Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:55:09.423319Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}) node_id = 4 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66792026-03-03T18:55:10.162ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
66802026-03-03T18:55:10.162ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
66812026-03-03T18:55:10.165ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66822026-03-03T18:55:10.165ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66832026-03-03T18:55:10.165ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66842026-03-03T18:55:10.167ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66852026-03-03T18:55:10.167ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66862026-03-03T18:55:10.168ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66872026-03-03T18:55:10.169ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66882026-03-03T18:55:10.169ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66892026-03-03T18:55:10.169ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66902026-03-03T18:55:10.170ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66912026-03-03T18:55:10.170ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66922026-03-03T18:55:10.171ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66932026-03-03T18:55:10.171ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66942026-03-03T18:55:10.171ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66952026-03-03T18:55:10.173ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66962026-03-03T18:55:10.173ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66972026-03-03T18:55:10.173ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66982026-03-03T18:55:10.173ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
66992026-03-03T18:55:10.175ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67002026-03-03T18:55:10.175ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67012026-03-03T18:55:10.175ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67022026-03-03T18:55:10.176ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67032026-03-03T18:55:10.179ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67042026-03-03T18:55:10.183ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67052026-03-03T18:55:10.183ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67062026-03-03T18:55:10.183ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67072026-03-03T18:55:10.184ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67082026-03-03T18:55:10.187ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67092026-03-03T18:55:10.187ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67102026-03-03T18:55:10.187ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67112026-03-03T18:55:10.187ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67122026-03-03T18:55:10.188ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67132026-03-03T18:55:10.191ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67142026-03-03T18:55:10.191ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67152026-03-03T18:55:10.191ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67162026-03-03T18:55:10.191ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67172026-03-03T18:55:10.195ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67182026-03-03T18:55:10.195ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67192026-03-03T18:55:10.195ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67202026-03-03T18:55:10.195ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67212026-03-03T18:55:10.197ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67222026-03-03T18:55:10.202ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = ListLocalStorage silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67232026-03-03T18:55:10.204ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67242026-03-03T18:55:10.204ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 5 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67252026-03-03T18:55:10.206ZDEBGtest_instance_metrics (SEC): saga log event new_state = N017 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67262026-03-03T18:55:10.206ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67272026-03-03T18:55:10.208ZDEBGtest_instance_metrics (SEC): saga log event new_state = N017 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67282026-03-03T18:55:10.208ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67292026-03-03T18:55:10.210ZDEBGtest_instance_metrics (SEC): saga log event new_state = N016 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67302026-03-03T18:55:10.210ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67312026-03-03T18:55:10.214ZDEBGtest_instance_metrics (SEC): saga log event new_state = N016 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67322026-03-03T18:55:10.214ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67332026-03-03T18:55:10.214ZDEBGtest_instance_metrics (SEC): saga log event new_state = N015 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67342026-03-03T18:55:10.214ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67352026-03-03T18:55:10.215ZDEBGtest_instance_metrics (SEC): saga log event new_state = N015 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67362026-03-03T18:55:10.216ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67372026-03-03T18:55:10.217ZDEBGtest_instance_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67382026-03-03T18:55:10.217ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67392026-03-03T18:55:10.219ZDEBGtest_instance_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67402026-03-03T18:55:10.219ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67412026-03-03T18:55:10.220ZDEBGtest_instance_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67422026-03-03T18:55:10.220ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67432026-03-03T18:55:10.221ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
67442026-03-03T18:55:10.221ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
67452026-03-03T18:55:10.222ZDEBGtest_instance_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67462026-03-03T18:55:10.222ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67472026-03-03T18:55:10.226ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67482026-03-03T18:55:10.226ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67492026-03-03T18:55:10.233ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67502026-03-03T18:55:10.234ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67512026-03-03T18:55:10.235ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67522026-03-03T18:55:10.235ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67532026-03-03T18:55:10.238ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67542026-03-03T18:55:10.238ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67552026-03-03T18:55:10.239ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67562026-03-03T18:55:10.239ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67572026-03-03T18:55:10.241ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67582026-03-03T18:55:10.241ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67592026-03-03T18:55:10.243ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67602026-03-03T18:55:10.243ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67612026-03-03T18:55:10.247ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67622026-03-03T18:55:10.247ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67632026-03-03T18:55:10.249ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67642026-03-03T18:55:10.249ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67652026-03-03T18:55:10.251ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67662026-03-03T18:55:10.252ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67672026-03-03T18:55:10.252ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67682026-03-03T18:55:10.252ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67692026-03-03T18:55:10.256ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67702026-03-03T18:55:10.256ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67712026-03-03T18:55:10.260ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67722026-03-03T18:55:10.260ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67732026-03-03T18:55:10.267ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
67742026-03-03T18:55:10.267ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67752026-03-03T18:55:10.267ZDEBGtest_instance_metrics (SEC): saga log event new_state = N018 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
67762026-03-03T18:55:10.267ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
67772026-03-03T18:55:10.269ZINFOtest_instance_metrics (SagaExecutor): start saga: ensuring instance dpd configuration instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start start_reason = AutoStart
67782026-03-03T18:55:10.269ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
67792026-03-03T18:55:10.269ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
67802026-03-03T18:55:10.270ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
67812026-03-03T18:55:10.272ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
67822026-03-03T18:55:10.272ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
67832026-03-03T18:55:10.272ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
67842026-03-03T18:55:10.272ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
67852026-03-03T18:55:10.273ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
67862026-03-03T18:55:10.274ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
67872026-03-03T18:55:10.277ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
67882026-03-03T18:55:10.277ZINFOtest_instance_metrics (nexus): looking up instance's primary network interface instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2
67892026-03-03T18:55:10.277ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67902026-03-03T18:55:10.277ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67912026-03-03T18:55:10.278ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67922026-03-03T18:55:10.279ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67932026-03-03T18:55:10.279ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67942026-03-03T18:55:10.280ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67952026-03-03T18:55:10.281ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67962026-03-03T18:55:10.281ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67972026-03-03T18:55:10.281ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67982026-03-03T18:55:10.288ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
67992026-03-03T18:55:10.288ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68002026-03-03T18:55:10.288ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68012026-03-03T18:55:10.288ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68022026-03-03T18:55:10.289ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68032026-03-03T18:55:10.292ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68042026-03-03T18:55:10.292ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68052026-03-03T18:55:10.292ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68062026-03-03T18:55:10.293ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68072026-03-03T18:55:10.294ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68082026-03-03T18:55:10.294ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68092026-03-03T18:55:10.294ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68102026-03-03T18:55:10.295ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68112026-03-03T18:55:10.296ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68122026-03-03T18:55:10.302ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68132026-03-03T18:55:10.302ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68142026-03-03T18:55:10.302ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68152026-03-03T18:55:10.302ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68162026-03-03T18:55:10.302ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68172026-03-03T18:55:10.304ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68182026-03-03T18:55:10.310ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68192026-03-03T18:55:10.311ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68202026-03-03T18:55:10.311ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68212026-03-03T18:55:10.311ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68222026-03-03T18:55:10.311ZTRACtest_instance_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68232026-03-03T18:55:10.313ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68242026-03-03T18:55:10.313ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68252026-03-03T18:55:10.313ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68262026-03-03T18:55:10.313ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68272026-03-03T18:55:10.322ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
68282026-03-03T18:55:10.322ZTRACtest_instance_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68292026-03-03T18:55:10.322ZDEBGtest_instance_metrics (results-sink-cluster): inserting 12 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
68302026-03-03T18:55:10.324ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68312026-03-03T18:55:10.328ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68322026-03-03T18:55:10.329ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68332026-03-03T18:55:10.329ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68342026-03-03T18:55:10.329ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68352026-03-03T18:55:10.332ZINFOtest_instance_metrics (nexus): looking up instance's external IPs instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2
68362026-03-03T18:55:10.332ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68372026-03-03T18:55:10.333ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68382026-03-03T18:55:10.333ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68392026-03-03T18:55:10.339ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68402026-03-03T18:55:10.339ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68412026-03-03T18:55:10.340ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68422026-03-03T18:55:10.342ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
68432026-03-03T18:55:10.342ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
68442026-03-03T18:55:10.342ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
68452026-03-03T18:55:10.342ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
68462026-03-03T18:55:10.343ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
68472026-03-03T18:55:10.344ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
68482026-03-03T18:55:10.346ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
68492026-03-03T18:55:10.346ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
68502026-03-03T18:55:10.346ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
68512026-03-03T18:55:10.346ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
68522026-03-03T18:55:10.349ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
68532026-03-03T18:55:10.350ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 71 53 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 qS..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:5722 req_id = 30533704-617d-42d1-9d90-d5388cb7c3ae
68542026-03-03T18:55:10.350ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 29011,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:5722 req_id = 30533704-617d-42d1-9d90-d5388cb7c3ae
68552026-03-03T18:55:10.350ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
68562026-03-03T18:55:10.350ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
68572026-03-03T18:55:10.350ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:5722 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 30533704-617d-42d1-9d90-d5388cb7c3ae
68582026-03-03T18:55:10.350ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1847, tv_nsec: 615585808 } })
68592026-03-03T18:55:10.351ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
68602026-03-03T18:55:10.351ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 3e 0d 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e >...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:29782 req_id = 640b0c49-f291-4b3c-b957-1957f7899328
68612026-03-03T18:55:10.351ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 15885,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:29782 req_id = 640b0c49-f291-4b3c-b957-1957f7899328
68622026-03-03T18:55:10.351ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
68632026-03-03T18:55:10.351ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:29782 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 640b0c49-f291-4b3c-b957-1957f7899328
68642026-03-03T18:55:10.376ZTRACtest_instance_metrics (DpdClient): client request body = None method = GET uri = http://[::1]:39131/switch/identifiers
68652026-03-03T18:55:10.377ZTRACtest_instance_metrics (DpdClient): client response result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7dc15f1-a92a-4181-bab5-9987c1ca2c88", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
68662026-03-03T18:55:10.379ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68672026-03-03T18:55:10.380ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68682026-03-03T18:55:10.381ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = DpdEnsure silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
68692026-03-03T18:55:10.385ZINFOtest_instance_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
68702026-03-03T18:55:10.386ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
68712026-03-03T18:55:10.386ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = afdfe562-51ed-4719-b800-ab50778767aa uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
68722026-03-03T18:55:10.387ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = afdfe562-51ed-4719-b800-ab50778767aa uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
68732026-03-03T18:55:10.387ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = afdfe562-51ed-4719-b800-ab50778767aa resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
68742026-03-03T18:55:10.387ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = afdfe562-51ed-4719-b800-ab50778767aa roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
68752026-03-03T18:55:10.387ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = afdfe562-51ed-4719-b800-ab50778767aa resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
68762026-03-03T18:55:10.395ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 9277 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = afdfe562-51ed-4719-b800-ab50778767aa response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
68772026-03-03T18:55:10.396ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
68782026-03-03T18:55:10.398ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "afdfe562-51ed-4719-b800-ab50778767aa", "content-length": "405", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
68792026-03-03T18:55:10.403ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
68802026-03-03T18:55:10.403ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
68812026-03-03T18:55:10.404ZDEBGtest_instance_metrics (nexus): no subnets attached to instance, nothing to notify Dendrite about instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2
68822026-03-03T18:55:10.404ZDEBGtest_instance_metrics (SEC): saga log event new_state = N018 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
68832026-03-03T18:55:10.404ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
68842026-03-03T18:55:10.404ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = b8fd551a-1a4d-4c78-9e30-4819b2e04a86 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
68852026-03-03T18:55:10.404ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = b8fd551a-1a4d-4c78-9e30-4819b2e04a86 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
68862026-03-03T18:55:10.405ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = b8fd551a-1a4d-4c78-9e30-4819b2e04a86 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
68872026-03-03T18:55:10.405ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = b8fd551a-1a4d-4c78-9e30-4819b2e04a86 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
68882026-03-03T18:55:10.406ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = b8fd551a-1a4d-4c78-9e30-4819b2e04a86 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
68892026-03-03T18:55:10.407ZDEBGtest_instance_metrics (SEC): saga log event new_state = N019 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
68902026-03-03T18:55:10.407ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
68912026-03-03T18:55:10.408ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
68922026-03-03T18:55:10.409ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
68932026-03-03T18:55:10.409ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
68942026-03-03T18:55:10.409ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
68952026-03-03T18:55:10.410ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 4643 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = b8fd551a-1a4d-4c78-9e30-4819b2e04a86 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
68962026-03-03T18:55:10.410ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8fd551a-1a4d-4c78-9e30-4819b2e04a86", "content-length": "29", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
68972026-03-03T18:55:10.410ZTRACtest_instance_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
68982026-03-03T18:55:10.410ZTRACtest_instance_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
68992026-03-03T18:55:10.410ZINFOtest_instance_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
69002026-03-03T18:55:10.410ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Signaled
69012026-03-03T18:55:10.410ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
69022026-03-03T18:55:10.410ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69032026-03-03T18:55:10.410ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
69042026-03-03T18:55:10.411ZDEBGtest_instance_metrics (SEC): saga log event new_state = N019 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
69052026-03-03T18:55:10.411ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
69062026-03-03T18:55:10.413ZDEBGtest_instance_metrics (SEC): saga log event new_state = N020 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
69072026-03-03T18:55:10.413ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 20 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
69082026-03-03T18:55:10.415ZINFOtest_instance_metrics (SagaExecutor): start saga: ensuring instance is registered on sled instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
69092026-03-03T18:55:10.416ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69102026-03-03T18:55:10.416ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69112026-03-03T18:55:10.416ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69122026-03-03T18:55:10.417ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69132026-03-03T18:55:10.417ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69142026-03-03T18:55:10.418ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69152026-03-03T18:55:10.419ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
69162026-03-03T18:55:10.419ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69172026-03-03T18:55:10.419ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
69182026-03-03T18:55:10.420ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69192026-03-03T18:55:10.420ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69202026-03-03T18:55:10.421ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69212026-03-03T18:55:10.426ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
69222026-03-03T18:55:10.426ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
69232026-03-03T18:55:10.426ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
69242026-03-03T18:55:10.426ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69252026-03-03T18:55:10.426ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
69262026-03-03T18:55:10.428ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69272026-03-03T18:55:10.428ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69282026-03-03T18:55:10.428ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69292026-03-03T18:55:10.428ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69302026-03-03T18:55:10.428ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69312026-03-03T18:55:10.429ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69322026-03-03T18:55:10.432ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69332026-03-03T18:55:10.432ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
69342026-03-03T18:55:10.432ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
69352026-03-03T18:55:10.432ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
69362026-03-03T18:55:10.432ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69372026-03-03T18:55:10.432ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
69382026-03-03T18:55:10.435ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
69392026-03-03T18:55:10.435ZDEBGtest_instance_metrics (results-sink-cluster): inserting 2 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
69402026-03-03T18:55:10.435ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69412026-03-03T18:55:10.438ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69422026-03-03T18:55:10.438ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
69432026-03-03T18:55:10.438ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69442026-03-03T18:55:10.438ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
69452026-03-03T18:55:10.439ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69462026-03-03T18:55:10.439ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69472026-03-03T18:55:10.439ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69482026-03-03T18:55:10.440ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69492026-03-03T18:55:10.450ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:37139/v2p
69502026-03-03T18:55:10.450ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69512026-03-03T18:55:10.451ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69522026-03-03T18:55:10.451ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69532026-03-03T18:55:10.451ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69542026-03-03T18:55:10.452ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44664 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
69552026-03-03T18:55:10.452ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44664 req_id = 763f71c6-ed29-4359-927b-30346ac3e616 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
69562026-03-03T18:55:10.452ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44664 req_id = 763f71c6-ed29-4359-927b-30346ac3e616 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
69572026-03-03T18:55:10.452ZINFOtest_instance_metrics (dropshot): request completed latency_us = 170 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44664 req_id = 763f71c6-ed29-4359-927b-30346ac3e616 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
69582026-03-03T18:55:10.453ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:37139/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "763f71c6-ed29-4359-927b-30346ac3e616", "content-length": "2", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
69592026-03-03T18:55:10.453ZINFOtest_instance_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
69602026-03-03T18:55:10.453ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
69612026-03-03T18:55:10.453ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [VirtualNetworkInterfaceHost { physical_host_ip: ::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014) }] sled = SimGimlet00
69622026-03-03T18:55:10.453ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = Some(Body) method = PUT uri = http://[::1]:37139/v2p
69632026-03-03T18:55:10.453ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44664 req_id = f83c9b7f-f8b0-4b66-b7bb-271d14af51cf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
69642026-03-03T18:55:10.453ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44664 req_id = f83c9b7f-f8b0-4b66-b7bb-271d14af51cf sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
69652026-03-03T18:55:10.453ZINFOtest_instance_metrics (dropshot): request completed latency_us = 220 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44664 req_id = f83c9b7f-f8b0-4b66-b7bb-271d14af51cf response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
69662026-03-03T18:55:10.453ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69672026-03-03T18:55:10.458ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69682026-03-03T18:55:10.458ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69692026-03-03T18:55:10.458ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69702026-03-03T18:55:10.458ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69712026-03-03T18:55:10.458ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69722026-03-03T18:55:10.458ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69732026-03-03T18:55:10.460ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:37139/v2p", status: 204, headers: {"x-request-id": "f83c9b7f-f8b0-4b66-b7bb-271d14af51cf", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
69742026-03-03T18:55:10.460ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 49.364219ms iteration = 2 status = {}
69752026-03-03T18:55:10.460ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69762026-03-03T18:55:10.460ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69772026-03-03T18:55:10.460ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69782026-03-03T18:55:10.461ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69792026-03-03T18:55:10.463ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69802026-03-03T18:55:10.463ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69812026-03-03T18:55:10.463ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69822026-03-03T18:55:10.463ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69832026-03-03T18:55:10.465ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69842026-03-03T18:55:10.469ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69852026-03-03T18:55:10.474ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69862026-03-03T18:55:10.474ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69872026-03-03T18:55:10.474ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69882026-03-03T18:55:10.474ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69892026-03-03T18:55:10.474ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69902026-03-03T18:55:10.474ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69912026-03-03T18:55:10.474ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69922026-03-03T18:55:10.474ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69932026-03-03T18:55:10.478ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69942026-03-03T18:55:10.478ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69952026-03-03T18:55:10.478ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69962026-03-03T18:55:10.479ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69972026-03-03T18:55:10.481ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69982026-03-03T18:55:10.481ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
69992026-03-03T18:55:10.481ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70002026-03-03T18:55:10.481ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70012026-03-03T18:55:10.486ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70022026-03-03T18:55:10.488ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70032026-03-03T18:55:10.489ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70042026-03-03T18:55:10.489ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70052026-03-03T18:55:10.489ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70062026-03-03T18:55:10.489ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70072026-03-03T18:55:10.491ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70082026-03-03T18:55:10.492ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70092026-03-03T18:55:10.499ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70102026-03-03T18:55:10.499ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70112026-03-03T18:55:10.499ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70122026-03-03T18:55:10.509ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70132026-03-03T18:55:10.509ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70142026-03-03T18:55:10.509ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70152026-03-03T18:55:10.510ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70162026-03-03T18:55:10.516ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70172026-03-03T18:55:10.521ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70182026-03-03T18:55:10.521ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70192026-03-03T18:55:10.521ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70202026-03-03T18:55:10.521ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70212026-03-03T18:55:10.525ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70222026-03-03T18:55:10.525ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70232026-03-03T18:55:10.525ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70242026-03-03T18:55:10.527ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70252026-03-03T18:55:10.527ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70262026-03-03T18:55:10.528ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70272026-03-03T18:55:10.533ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70282026-03-03T18:55:10.534ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70292026-03-03T18:55:10.537ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70302026-03-03T18:55:10.537ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
70312026-03-03T18:55:10.537ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70322026-03-03T18:55:10.537ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70332026-03-03T18:55:10.537ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70342026-03-03T18:55:10.539ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70352026-03-03T18:55:10.539ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70362026-03-03T18:55:10.539ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70372026-03-03T18:55:10.540ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70382026-03-03T18:55:10.541ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70392026-03-03T18:55:10.541ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70402026-03-03T18:55:10.541ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70412026-03-03T18:55:10.541ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70422026-03-03T18:55:10.543ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70432026-03-03T18:55:10.543ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70442026-03-03T18:55:10.543ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70452026-03-03T18:55:10.544ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70462026-03-03T18:55:10.546ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70472026-03-03T18:55:10.546ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70482026-03-03T18:55:10.546ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70492026-03-03T18:55:10.548ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70502026-03-03T18:55:10.554ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70512026-03-03T18:55:10.560ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70522026-03-03T18:55:10.560ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70532026-03-03T18:55:10.560ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70542026-03-03T18:55:10.560ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70552026-03-03T18:55:10.560ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70562026-03-03T18:55:10.561ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70572026-03-03T18:55:10.563ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70582026-03-03T18:55:10.563ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70592026-03-03T18:55:10.563ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70602026-03-03T18:55:10.564ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70612026-03-03T18:55:10.565ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70622026-03-03T18:55:10.565ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70632026-03-03T18:55:10.566ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70642026-03-03T18:55:10.566ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70652026-03-03T18:55:10.568ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70662026-03-03T18:55:10.572ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70672026-03-03T18:55:10.572ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70682026-03-03T18:55:10.572ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70692026-03-03T18:55:10.573ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70702026-03-03T18:55:10.574ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70712026-03-03T18:55:10.574ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70722026-03-03T18:55:10.575ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70732026-03-03T18:55:10.576ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70742026-03-03T18:55:10.576ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70752026-03-03T18:55:10.577ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70762026-03-03T18:55:10.578ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70772026-03-03T18:55:10.578ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70782026-03-03T18:55:10.578ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70792026-03-03T18:55:10.580ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70802026-03-03T18:55:10.580ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70812026-03-03T18:55:10.580ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70822026-03-03T18:55:10.580ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70832026-03-03T18:55:10.580ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70842026-03-03T18:55:10.582ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70852026-03-03T18:55:10.582ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70862026-03-03T18:55:10.582ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70872026-03-03T18:55:10.583ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70882026-03-03T18:55:10.585ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70892026-03-03T18:55:10.585ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70902026-03-03T18:55:10.585ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70912026-03-03T18:55:10.585ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70922026-03-03T18:55:10.587ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70932026-03-03T18:55:10.592ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70942026-03-03T18:55:10.592ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70952026-03-03T18:55:10.592ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70962026-03-03T18:55:10.592ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70972026-03-03T18:55:10.592ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70982026-03-03T18:55:10.592ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
70992026-03-03T18:55:10.594ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71002026-03-03T18:55:10.595ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71012026-03-03T18:55:10.595ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71022026-03-03T18:55:10.595ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71032026-03-03T18:55:10.597ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71042026-03-03T18:55:10.597ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71052026-03-03T18:55:10.597ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71062026-03-03T18:55:10.597ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71072026-03-03T18:55:10.606ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71082026-03-03T18:55:10.611ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ByName("default") } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71092026-03-03T18:55:10.611ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71102026-03-03T18:55:10.611ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71112026-03-03T18:55:10.611ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71122026-03-03T18:55:10.615ZDEBGtest_instance_metrics (nexus): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {Name("default"): [NetworkInterface { id: 08bb2f95-b0bf-4966-80c9-3dce6987404e, kind: Instance { id: 62af126f-88fe-4275-b8a4-75b87584f9b2 }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014), primary: true, slot: 0 }]}
71132026-03-03T18:55:10.615ZDEBGtest_instance_metrics (nexus): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08bb2f95-b0bf-4966-80c9-3dce6987404e, kind: Instance { id: 62af126f-88fe-4275-b8a4-75b87584f9b2 }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(None)]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08bb2f95-b0bf-4966-80c9-3dce6987404e, kind: Instance { id: 62af126f-88fe-4275-b8a4-75b87584f9b2 }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014), primary: true, slot: 0 }], filter_hosts: Some({Vpc(Vni(13437014))}), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08bb2f95-b0bf-4966-80c9-3dce6987404e, kind: Instance { id: 62af126f-88fe-4275-b8a4-75b87584f9b2 }, name: Name("net0"), ip_config: V4(PrivateIpv4Config { ip: 172.30.0.5, subnet: Ipv4Net { addr: 172.30.0.0, width: 22 }, transit_ips: [] }), mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
71142026-03-03T18:55:10.616ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71152026-03-03T18:55:10.616ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71162026-03-03T18:55:10.619ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71172026-03-03T18:55:10.620ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71182026-03-03T18:55:10.620ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71192026-03-03T18:55:10.620ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71202026-03-03T18:55:10.623ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71212026-03-03T18:55:10.623ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71222026-03-03T18:55:10.623ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71232026-03-03T18:55:10.623ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71242026-03-03T18:55:10.623ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71252026-03-03T18:55:10.625ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71262026-03-03T18:55:10.625ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71272026-03-03T18:55:10.625ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71282026-03-03T18:55:10.625ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71292026-03-03T18:55:10.627ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71302026-03-03T18:55:10.627ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71312026-03-03T18:55:10.627ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71322026-03-03T18:55:10.628ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71332026-03-03T18:55:10.629ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71342026-03-03T18:55:10.635ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71352026-03-03T18:55:10.636ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71362026-03-03T18:55:10.636ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71372026-03-03T18:55:10.636ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71382026-03-03T18:55:10.650ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
71392026-03-03T18:55:10.650ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
71402026-03-03T18:55:10.651ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
71412026-03-03T18:55:10.652ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
71422026-03-03T18:55:10.652ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71432026-03-03T18:55:10.652ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
71442026-03-03T18:55:10.652ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
71452026-03-03T18:55:10.653ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
71462026-03-03T18:55:10.654ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
71472026-03-03T18:55:10.657ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
71482026-03-03T18:55:10.658ZDEBGtest_instance_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:37139/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
71492026-03-03T18:55:10.658ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44666 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
71502026-03-03T18:55:10.659ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44666 req_id = 724be370-e908-459a-b4c6-bb360e5b241b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
71512026-03-03T18:55:10.659ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44666 req_id = 724be370-e908-459a-b4c6-bb360e5b241b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 version = 23.0.0
71522026-03-03T18:55:10.660ZINFOtest_instance_metrics (SledAgent): created id = 4b5695ce-ffd0-4755-b762-191fd8be0384 initial_state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T18:55:10.657768612Z }, migration_in: None, migration_out: None } kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
71532026-03-03T18:55:10.660ZINFOtest_instance_metrics (dropshot): request completed latency_us = 1586 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44666 req_id = 724be370-e908-459a-b4c6-bb360e5b241b response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
71542026-03-03T18:55:10.661ZDEBGtest_instance_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:37139/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384", status: 200, headers: {"content-type": "application/json", "x-request-id": "724be370-e908-459a-b4c6-bb360e5b241b", "content-length": "131", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
71552026-03-03T18:55:10.661ZINFOtest_instance_metrics (SagaExecutor): received new VMM runtime state from sled agent authenticated = true migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T18:55:10.657768612Z }
71562026-03-03T18:55:10.661ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71572026-03-03T18:55:10.661ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71582026-03-03T18:55:10.661ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRegistered silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71592026-03-03T18:55:10.690ZDEBGtest_instance_metrics (SEC): saga log event new_state = N020 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
71602026-03-03T18:55:10.690ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T18:55:10.657768612Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:55:10.033378Z"), "time_deleted": Null}) node_id = 20 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
71612026-03-03T18:55:10.697ZDEBGtest_instance_metrics (SEC): saga log event new_state = N021 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
71622026-03-03T18:55:10.697ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 21 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
71632026-03-03T18:55:10.704ZINFOtest_instance_metrics (SagaExecutor): start saga: updating multicast member sled_id instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
71642026-03-03T18:55:10.704ZDEBGtest_instance_metrics (SagaExecutor): multicast member lifecycle transition: updating sled_id authenticated = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 new_sled_id = Some(b6d65341-167c-41df-9b5c-41cded99c229 (sled)) operation = instance_start_or_migrate saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71652026-03-03T18:55:10.704ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71662026-03-03T18:55:10.704ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71672026-03-03T18:55:10.705ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = UpdateMulticastSledId silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71682026-03-03T18:55:10.707ZDEBGtest_instance_metrics (SEC): saga log event new_state = N021 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
71692026-03-03T18:55:10.707ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 21 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
71702026-03-03T18:55:10.709ZDEBGtest_instance_metrics (SEC): saga log event new_state = N022 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
71712026-03-03T18:55:10.709ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 22 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
71722026-03-03T18:55:10.711ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71732026-03-03T18:55:10.711ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71742026-03-03T18:55:10.711ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = AddVirtualResources silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71752026-03-03T18:55:10.717ZDEBGtest_instance_metrics (SEC): saga log event new_state = N022 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
71762026-03-03T18:55:10.717ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 22 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
71772026-03-03T18:55:10.719ZDEBGtest_instance_metrics (SEC): saga log event new_state = N023 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
71782026-03-03T18:55:10.719ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 23 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
71792026-03-03T18:55:10.723ZINFOtest_instance_metrics (SagaExecutor): start saga: ensuring instance is running instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start sled_id = b6d65341-167c-41df-9b5c-41cded99c229 start_reason = AutoStart
71802026-03-03T18:55:10.732ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
71812026-03-03T18:55:10.732ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
71822026-03-03T18:55:10.733ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
71832026-03-03T18:55:10.735ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
71842026-03-03T18:55:10.735ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
71852026-03-03T18:55:10.735ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
71862026-03-03T18:55:10.736ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
71872026-03-03T18:55:10.736ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
71882026-03-03T18:55:10.740ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
71892026-03-03T18:55:10.740ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
71902026-03-03T18:55:10.740ZDEBGtest_instance_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:37139/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state
71912026-03-03T18:55:10.741ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44668 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
71922026-03-03T18:55:10.741ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44668 req_id = b3fb698a-6b89-476d-bdda-db6873d60735 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state
71932026-03-03T18:55:10.741ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44668 req_id = b3fb698a-6b89-476d-bdda-db6873d60735 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state version = 23.0.0
71942026-03-03T18:55:10.742ZINFOtest_instance_metrics (SledAgent): noop transition id = 4b5695ce-ffd0-4755-b762-191fd8be0384 kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 target = Running
71952026-03-03T18:55:10.742ZINFOtest_instance_metrics (dropshot): request completed latency_us = 604 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44668 req_id = b3fb698a-6b89-476d-bdda-db6873d60735 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state
71962026-03-03T18:55:10.742ZDEBGtest_instance_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:37139/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3fb698a-6b89-476d-bdda-db6873d60735", "content-length": "151", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
71972026-03-03T18:55:10.742ZINFOtest_instance_metrics (SagaExecutor): received new VMM runtime state from sled agent authenticated = true migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user vmm_state = VmmRuntimeState { state: Starting, generation: Generation(2), time_updated: 2026-03-03T18:55:10.657768612Z }
71982026-03-03T18:55:10.742ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
71992026-03-03T18:55:10.742ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
72002026-03-03T18:55:10.743ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_node = EnsureRunning silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
72012026-03-03T18:55:10.753ZDEBGtest_instance_metrics (SEC): saga log event new_state = N023 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
72022026-03-03T18:55:10.753ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 23 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
72032026-03-03T18:55:10.758ZDEBGtest_instance_metrics (SEC): saga log event new_state = N025 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
72042026-03-03T18:55:10.758ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 25 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
72052026-03-03T18:55:10.760ZDEBGtest_instance_metrics (SEC): saga log event new_state = N025 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
72062026-03-03T18:55:10.760ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 25 saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
72072026-03-03T18:55:10.762ZINFOtest_instance_metrics (SEC): update for saga cached state new_state = Done saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 sec_id = 913233fe-92a8-4635-9572-183f495429c4
72082026-03-03T18:55:10.762ZINFOtest_instance_metrics (SecStore): updating state new_state = done saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
72092026-03-03T18:55:10.765ZINFOtest_instance_metrics (SEC): saga finished result = success saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start sec_id = 913233fe-92a8-4635-9572-183f495429c4
72102026-03-03T18:55:10.765ZINFOtest_instance_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7
72112026-03-03T18:55:10.765ZINFOtest_instance_metrics (SagaExecutor): saga finished saga_id = 912c8369-eaf0-48be-917e-aa7ab50d10f7 saga_name = instance-start saga_result = SagaResult { saga_id: 912c8369-eaf0-48be-917e-aa7ab50d10f7, saga_log: SagaLog { saga_id: 912c8369-eaf0-48be-917e-aa7ab50d10f7, unwinding: false, events: [N024 started, N024 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N017 started, N017 succeeded, N016 started, N016 succeeded, N015 started, N015 succeeded, N014 started, N014 succeeded, N013 started, N013 succeeded, N012 started, N012 succeeded, N011 started, N011 succeeded, N010 started, N010 succeeded, N009 started, N009 succeeded, N008 started, N008 succeeded, N007 started, N007 succeeded, N006 started, N006 succeeded, N018 started, N018 succeeded, N019 started, N019 succeeded, N020 started, N020 succeeded, N021 started, N021 succeeded, N022 started, N022 succeeded, N023 started, N023 succeeded, N025 started, N025 succeeded], node_status: {0: Succeeded(String("4b5695ce-ffd0-4755-b762-191fd8be0384")), 1: Succeeded(String("b6d65341-167c-41df-9b5c-41cded99c229")), 2: Succeeded(String("::1:0")), 3: Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T18:55:10.033378Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:55:10.033378Z"), "time_deleted": Null}), 4: Succeeded(Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"just-rainsticks\\""), "id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "name": String("just-rainsticks"), "time_created": String("2026-03-03T18:55:09.423319Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:09.423319Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:55:09.423319Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}), 5: Succeeded(Array []), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null), 20: Succeeded(Object {"cpu_platform": String("AmdMilan"), "id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T18:55:10.657768612Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:55:10.033378Z"), "time_deleted": Null}), 21: Succeeded(Null), 22: Succeeded(Null), 23: Succeeded(Null), 24: Succeeded(Null), 25: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"dpd_ensure": Null, "ensure_local_storage_0": Null, "ensure_local_storage_1": Null, "ensure_local_storage_10": Null, "ensure_local_storage_11": Null, "ensure_local_storage_2": Null, "ensure_local_storage_3": Null, "ensure_local_storage_4": Null, "ensure_local_storage_5": Null, "ensure_local_storage_6": Null, "ensure_local_storage_7": Null, "ensure_local_storage_8": Null, "ensure_local_storage_9": Null, "ensure_registered": Object {"cpu_platform": String("AmdMilan"), "id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(2), "state": String("Starting"), "time_state_updated": String("2026-03-03T18:55:10.657768612Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:55:10.033378Z"), "time_deleted": Null}, "ensure_running": Null, "local_storage_records": Array [], "multicast_sled_id": Null, "propolis_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "propolis_ip": String("::1:0"), "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "started_record": Object {"auto_restart": Object {"cooldown": Null, "policy": Null}, "boot_disk_id": Null, "cpu_platform": Null, "hostname": String("the-host"), "identity": Object {"description": String("instance \\"just-rainsticks\\""), "id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "name": String("just-rainsticks"), "time_created": String("2026-03-03T18:55:09.423319Z"), "time_deleted": Null, "time_modified": String("2026-03-03T18:55:09.423319Z")}, "intended_state": String("Running"), "memory": Number(1073741824), "ncpus": Number(4), "project_id": String("f04dd7b1-f806-4002-8222-cf99123d65c7"), "runtime_state": Object {"dst_propolis_id": Null, "gen": Number(3), "migration_id": Null, "nexus_state": String("Vmm"), "propolis_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "time_last_auto_restarted": Null, "time_updated": String("2026-03-03T18:55:09.423319Z")}, "updater_gen": Number(1), "updater_id": Null, "user_data": Array [Number(35), Number(99), Number(108), Number(111), Number(117), Number(100), Number(45), Number(99), Number(111), Number(110), Number(102), Number(105), Number(103), Number(10), Number(115), Number(121), Number(115), Number(116), Number(101), Number(109), Number(95), Number(105), Number(110), Number(102), Number(111), Number(58), Number(10), Number(32), Number(32), Number(100), Number(101), Number(102), Number(97), Number(117), Number(108), Number(116), Number(95), Number(117), Number(115), Number(101), Number(114), Number(58), Number(10), Number(32), Number(32), Number(32), Number(32), Number(110), Number(97), Number(109), Number(101), Number(58), Number(32), Number(111), Number(120), Number(105), Number(100), Number(101)]}, "v2p_ensure": Null, "virtual_resources": Null, "vmm_record": Object {"cpu_platform": String("AmdMilan"), "id": String("4b5695ce-ffd0-4755-b762-191fd8be0384"), "instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "propolis_ip": String("::1:0/128"), "propolis_port": Number(12400), "runtime": Object {"gen": Number(1), "state": String("Creating"), "time_state_updated": String("2026-03-03T18:55:10.033378Z")}, "sled_id": String("b6d65341-167c-41df-9b5c-41cded99c229"), "time_created": String("2026-03-03T18:55:10.033378Z"), "time_deleted": Null}} }) }
72122026-03-03T18:55:10.765ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72132026-03-03T18:55:10.765ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72142026-03-03T18:55:10.765ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72152026-03-03T18:55:10.765ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72162026-03-03T18:55:10.766ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72172026-03-03T18:55:10.766ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 4 reason = Signaled
72182026-03-03T18:55:10.766ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
72192026-03-03T18:55:10.766ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
72202026-03-03T18:55:10.766ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
72212026-03-03T18:55:10.767ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 7e fb 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ~............_de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:48220 req_id = 6a149d01-40ad-4fe6-8174-73961897626e
72222026-03-03T18:55:10.767ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 32507,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:48220 req_id = 6a149d01-40ad-4fe6-8174-73961897626e
72232026-03-03T18:55:10.767ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
72242026-03-03T18:55:10.767ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
72252026-03-03T18:55:10.767ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:48220 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 6a149d01-40ad-4fe6-8174-73961897626e
72262026-03-03T18:55:10.767ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1848, tv_nsec: 32333915 } })
72272026-03-03T18:55:10.767ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
72282026-03-03T18:55:10.768ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: dd 47 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .G..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:30820 req_id = f6f4484c-01a7-4333-81b8-2c1ae658e4bc
72292026-03-03T18:55:10.768ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 56647,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:30820 req_id = f6f4484c-01a7-4333-81b8-2c1ae658e4bc
72302026-03-03T18:55:10.768ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
72312026-03-03T18:55:10.768ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:30820 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = f6f4484c-01a7-4333-81b8-2c1ae658e4bc
72322026-03-03T18:55:10.788ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
72332026-03-03T18:55:10.788ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72342026-03-03T18:55:10.788ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72352026-03-03T18:55:10.788ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72362026-03-03T18:55:10.788ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72372026-03-03T18:55:10.796ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "d38552d1-b15c-4092-8d31-f300ef0271be", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
72382026-03-03T18:55:10.796ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
72392026-03-03T18:55:10.796ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
72402026-03-03T18:55:10.796ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
72412026-03-03T18:55:10.797ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
72422026-03-03T18:55:10.797ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72432026-03-03T18:55:10.798ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72442026-03-03T18:55:10.798ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72452026-03-03T18:55:10.798ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72462026-03-03T18:55:10.801ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
72472026-03-03T18:55:10.801ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
72482026-03-03T18:55:10.801ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
72492026-03-03T18:55:10.801ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
72502026-03-03T18:55:10.801ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
72512026-03-03T18:55:10.801ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72522026-03-03T18:55:10.806ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72532026-03-03T18:55:10.806ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72542026-03-03T18:55:10.806ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72552026-03-03T18:55:10.806ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72562026-03-03T18:55:10.807ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
72572026-03-03T18:55:10.808ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
72582026-03-03T18:55:10.808ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
72592026-03-03T18:55:10.808ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
72602026-03-03T18:55:10.809ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
72612026-03-03T18:55:10.809ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72622026-03-03T18:55:10.809ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72632026-03-03T18:55:10.809ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72642026-03-03T18:55:10.810ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Signaled
72652026-03-03T18:55:10.810ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
72662026-03-03T18:55:10.810ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
72672026-03-03T18:55:10.810ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72682026-03-03T18:55:10.810ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
72692026-03-03T18:55:10.810ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72702026-03-03T18:55:10.810ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72712026-03-03T18:55:10.818ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72722026-03-03T18:55:10.821ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72732026-03-03T18:55:10.821ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
72742026-03-03T18:55:10.821ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
72752026-03-03T18:55:10.821ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
72762026-03-03T18:55:10.821ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72772026-03-03T18:55:10.822ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72782026-03-03T18:55:10.822ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72792026-03-03T18:55:10.822ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72802026-03-03T18:55:10.823ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72812026-03-03T18:55:10.824ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72822026-03-03T18:55:10.824ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72832026-03-03T18:55:10.825ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72842026-03-03T18:55:10.825ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72852026-03-03T18:55:10.828ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72862026-03-03T18:55:10.828ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
72872026-03-03T18:55:10.828ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72882026-03-03T18:55:10.828ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72892026-03-03T18:55:10.829ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72902026-03-03T18:55:10.829ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72912026-03-03T18:55:10.829ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72922026-03-03T18:55:10.829ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72932026-03-03T18:55:10.830ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
72942026-03-03T18:55:10.839ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
72952026-03-03T18:55:10.839ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:37139/vpc-routes
72962026-03-03T18:55:10.839ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44670 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
72972026-03-03T18:55:10.840ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44670 req_id = c70e60a1-1ced-4a80-a56f-e22d7ad388ff sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
72982026-03-03T18:55:10.840ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44670 req_id = c70e60a1-1ced-4a80-a56f-e22d7ad388ff sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
72992026-03-03T18:55:10.840ZINFOtest_instance_metrics (dropshot): request completed latency_us = 210 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44670 req_id = c70e60a1-1ced-4a80-a56f-e22d7ad388ff response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
73002026-03-03T18:55:10.840ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c70e60a1-1ced-4a80-a56f-e22d7ad388ff", "content-length": "154", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
73012026-03-03T18:55:10.840ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73022026-03-03T18:55:10.840ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73032026-03-03T18:55:10.841ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73042026-03-03T18:55:10.841ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
73052026-03-03T18:55:10.841ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
73062026-03-03T18:55:10.841ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
73072026-03-03T18:55:10.841ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
73082026-03-03T18:55:10.842ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
73092026-03-03T18:55:10.842ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73102026-03-03T18:55:10.842ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73112026-03-03T18:55:10.842ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73122026-03-03T18:55:10.842ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73132026-03-03T18:55:10.844ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73142026-03-03T18:55:10.844ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73152026-03-03T18:55:10.844ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73162026-03-03T18:55:10.845ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73172026-03-03T18:55:10.846ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
73182026-03-03T18:55:10.846ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
73192026-03-03T18:55:10.846ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
73202026-03-03T18:55:10.846ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
73212026-03-03T18:55:10.847ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73222026-03-03T18:55:10.851ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73232026-03-03T18:55:10.852ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73242026-03-03T18:55:10.852ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73252026-03-03T18:55:10.852ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73262026-03-03T18:55:10.852ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73272026-03-03T18:55:10.852ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73282026-03-03T18:55:10.852ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
73292026-03-03T18:55:10.852ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
73302026-03-03T18:55:10.852ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
73312026-03-03T18:55:10.852ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
73322026-03-03T18:55:10.853ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
73332026-03-03T18:55:10.855ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73342026-03-03T18:55:10.855ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73352026-03-03T18:55:10.855ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73362026-03-03T18:55:10.857ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73372026-03-03T18:55:10.857ZINFOtest_instance_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
73382026-03-03T18:55:10.857ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/eip-gateways
73392026-03-03T18:55:10.858ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44670 req_id = 8074f04a-a220-4e33-8d26-c6350aca8245 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
73402026-03-03T18:55:10.858ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44670 req_id = 8074f04a-a220-4e33-8d26-c6350aca8245 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
73412026-03-03T18:55:10.858ZINFOtest_instance_metrics (dropshot): request completed latency_us = 250 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44670 req_id = 8074f04a-a220-4e33-8d26-c6350aca8245 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
73422026-03-03T18:55:10.858ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/eip-gateways", status: 204, headers: {"x-request-id": "8074f04a-a220-4e33-8d26-c6350aca8245", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
73432026-03-03T18:55:10.858ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73442026-03-03T18:55:10.858ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73452026-03-03T18:55:10.859ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73462026-03-03T18:55:10.865ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73472026-03-03T18:55:10.865ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73482026-03-03T18:55:10.865ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73492026-03-03T18:55:10.866ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73502026-03-03T18:55:10.869ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73512026-03-03T18:55:10.869ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73522026-03-03T18:55:10.870ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73532026-03-03T18:55:10.872ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73542026-03-03T18:55:10.876ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73552026-03-03T18:55:10.877ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73562026-03-03T18:55:10.877ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73572026-03-03T18:55:10.877ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73582026-03-03T18:55:10.878ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73592026-03-03T18:55:10.878ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73602026-03-03T18:55:10.878ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73612026-03-03T18:55:10.881ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73622026-03-03T18:55:10.881ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73632026-03-03T18:55:10.881ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73642026-03-03T18:55:10.881ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73652026-03-03T18:55:10.882ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73662026-03-03T18:55:10.882ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73672026-03-03T18:55:10.882ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73682026-03-03T18:55:10.883ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73692026-03-03T18:55:10.884ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73702026-03-03T18:55:10.884ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73712026-03-03T18:55:10.884ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73722026-03-03T18:55:10.885ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73732026-03-03T18:55:10.886ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73742026-03-03T18:55:10.886ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73752026-03-03T18:55:10.886ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73762026-03-03T18:55:10.886ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances?project=springfield-squidport
73772026-03-03T18:55:10.888ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73782026-03-03T18:55:10.888ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73792026-03-03T18:55:10.891ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73802026-03-03T18:55:10.894ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
73812026-03-03T18:55:10.894ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
73822026-03-03T18:55:10.895ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
73832026-03-03T18:55:10.895ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 129.314978ms iteration = 4 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
73842026-03-03T18:55:10.895ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 5 reason = Signaled
73852026-03-03T18:55:10.897ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
73862026-03-03T18:55:10.897ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
73872026-03-03T18:55:10.897ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
73882026-03-03T18:55:10.897ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 57 72 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 Wr..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:23417 req_id = 1b38b454-fa7c-4b81-8ace-735d13a4335f
73892026-03-03T18:55:10.897ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 22386,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:23417 req_id = 1b38b454-fa7c-4b81-8ace-735d13a4335f
73902026-03-03T18:55:10.898ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
73912026-03-03T18:55:10.898ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
73922026-03-03T18:55:10.898ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:23417 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 1b38b454-fa7c-4b81-8ace-735d13a4335f
73932026-03-03T18:55:10.898ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1848, tv_nsec: 163039515 } })
73942026-03-03T18:55:10.898ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
73952026-03-03T18:55:10.898ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
73962026-03-03T18:55:10.898ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73972026-03-03T18:55:10.899ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73982026-03-03T18:55:10.900ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: 6a 86 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e j...........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:1933 req_id = 98a70faa-39dd-4a96-904f-f3181eb94bd9
73992026-03-03T18:55:10.900ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 27270,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:1933 req_id = 98a70faa-39dd-4a96-904f-f3181eb94bd9
74002026-03-03T18:55:10.900ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
74012026-03-03T18:55:10.900ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:1933 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 98a70faa-39dd-4a96-904f-f3181eb94bd9
74022026-03-03T18:55:10.921ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
74032026-03-03T18:55:10.923ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) }
74042026-03-03T18:55:10.923ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
74052026-03-03T18:55:10.923ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74062026-03-03T18:55:10.923ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74072026-03-03T18:55:10.924ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74082026-03-03T18:55:10.925ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 1593293 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 0d35a68e-d554-40d8-988b-7c57d7cb66d1 response_code = 201 uri = /v1/instances?project=springfield-squidport
74092026-03-03T18:55:10.925ZINFOtest_instance_metrics (external client test context): client received response status = 201
74102026-03-03T18:55:10.926ZTRACtest_instance_metrics: authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
74112026-03-03T18:55:10.926ZDEBGtest_instance_metrics: roles roles = RoleSet { roles: {} }
74122026-03-03T18:55:10.926ZDEBGtest_instance_metrics: authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
74132026-03-03T18:55:10.927ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f767e6b-b106-430f-8a61-c9754b5f56bb", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:10 GMT"} })
74142026-03-03T18:55:10.927ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
74152026-03-03T18:55:10.927ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
74162026-03-03T18:55:10.927ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
74172026-03-03T18:55:10.929ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
74182026-03-03T18:55:10.932ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = POST uri = http://127.0.0.1:36591/v1/instances/just-rainsticks/stop?project=springfield-squidport
74192026-03-03T18:55:10.933ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
74202026-03-03T18:55:10.933ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74212026-03-03T18:55:10.933ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74222026-03-03T18:55:10.933ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74232026-03-03T18:55:10.934ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
74242026-03-03T18:55:10.934ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
74252026-03-03T18:55:10.934ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
74262026-03-03T18:55:10.934ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
74272026-03-03T18:55:10.934ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
74282026-03-03T18:55:10.935ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
74292026-03-03T18:55:10.935ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport version = 2026021900.0.0
74302026-03-03T18:55:10.935ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
74312026-03-03T18:55:10.935ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
74322026-03-03T18:55:10.935ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74332026-03-03T18:55:10.935ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74342026-03-03T18:55:10.936ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74352026-03-03T18:55:10.937ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
74362026-03-03T18:55:10.937ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74372026-03-03T18:55:10.937ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74382026-03-03T18:55:10.937ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74392026-03-03T18:55:10.937ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
74402026-03-03T18:55:10.937ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
74412026-03-03T18:55:10.937ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
74422026-03-03T18:55:10.938ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
74432026-03-03T18:55:10.938ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
74442026-03-03T18:55:10.938ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74452026-03-03T18:55:10.938ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74462026-03-03T18:55:10.939ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74472026-03-03T18:55:10.939ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74482026-03-03T18:55:10.945ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } result = Ok(())
74492026-03-03T18:55:10.945ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "VpcRouter" using built-in user background_task = vpc_route_manager
74502026-03-03T18:55:10.945ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) }
74512026-03-03T18:55:10.945ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
74522026-03-03T18:55:10.945ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74532026-03-03T18:55:10.945ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74542026-03-03T18:55:10.945ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74552026-03-03T18:55:10.953ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
74562026-03-03T18:55:10.953ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
74572026-03-03T18:55:10.953ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
74582026-03-03T18:55:10.953ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
74592026-03-03T18:55:10.953ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
74602026-03-03T18:55:10.954ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
74612026-03-03T18:55:10.954ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
74622026-03-03T18:55:10.954ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74632026-03-03T18:55:10.954ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74642026-03-03T18:55:10.955ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74652026-03-03T18:55:10.956ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
74662026-03-03T18:55:10.956ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74672026-03-03T18:55:10.956ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74682026-03-03T18:55:10.956ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74692026-03-03T18:55:10.957ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
74702026-03-03T18:55:10.957ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
74712026-03-03T18:55:10.957ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
74722026-03-03T18:55:10.957ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
74732026-03-03T18:55:10.957ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
74742026-03-03T18:55:10.957ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74752026-03-03T18:55:10.957ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74762026-03-03T18:55:10.958ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74772026-03-03T18:55:10.958ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
74782026-03-03T18:55:10.958ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74792026-03-03T18:55:10.958ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74802026-03-03T18:55:10.959ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74812026-03-03T18:55:10.960ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
74822026-03-03T18:55:10.960ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
74832026-03-03T18:55:10.960ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
74842026-03-03T18:55:10.960ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
74852026-03-03T18:55:10.960ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
74862026-03-03T18:55:10.961ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
74872026-03-03T18:55:10.963ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
74882026-03-03T18:55:10.963ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
74892026-03-03T18:55:10.963ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
74902026-03-03T18:55:10.963ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
74912026-03-03T18:55:10.964ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74922026-03-03T18:55:10.969ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: bb01fc78-45a4-4eed-8256-9ed2a649a798, lookup_type: ById(bb01fc78-45a4-4eed-8256-9ed2a649a798) } result = Ok(())
74932026-03-03T18:55:10.969ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
74942026-03-03T18:55:10.969ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74952026-03-03T18:55:10.969ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74962026-03-03T18:55:10.970ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
74972026-03-03T18:55:10.970ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
74982026-03-03T18:55:10.973ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
74992026-03-03T18:55:10.973ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 77.233183ms iteration = 5 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
75002026-03-03T18:55:10.973ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
75012026-03-03T18:55:10.975ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
75022026-03-03T18:55:10.975ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75032026-03-03T18:55:10.975ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75042026-03-03T18:55:10.975ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75052026-03-03T18:55:10.976ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75062026-03-03T18:55:10.976ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75072026-03-03T18:55:10.976ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75082026-03-03T18:55:10.978ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75092026-03-03T18:55:10.978ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
75102026-03-03T18:55:10.978ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
75112026-03-03T18:55:10.978ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
75122026-03-03T18:55:10.979ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75132026-03-03T18:55:10.979ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75142026-03-03T18:55:10.979ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75152026-03-03T18:55:10.980ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
75162026-03-03T18:55:10.983ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
75172026-03-03T18:55:10.983ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75182026-03-03T18:55:10.983ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75192026-03-03T18:55:10.983ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75202026-03-03T18:55:10.983ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75212026-03-03T18:55:10.983ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75222026-03-03T18:55:10.983ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75232026-03-03T18:55:10.984ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75242026-03-03T18:55:10.984ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75252026-03-03T18:55:10.984ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75262026-03-03T18:55:10.987ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75272026-03-03T18:55:10.987ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75282026-03-03T18:55:10.988ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75292026-03-03T18:55:10.991ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75302026-03-03T18:55:10.991ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75312026-03-03T18:55:10.991ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75322026-03-03T18:55:10.991ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75332026-03-03T18:55:10.991ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75342026-03-03T18:55:10.992ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ById(e879c791-c017-4ff2-8fbd-628089f569be) }
75352026-03-03T18:55:10.992ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
75362026-03-03T18:55:10.992ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75372026-03-03T18:55:10.992ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75382026-03-03T18:55:10.992ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75392026-03-03T18:55:10.992ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75402026-03-03T18:55:10.992ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75412026-03-03T18:55:10.993ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75422026-03-03T18:55:10.994ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
75432026-03-03T18:55:10.994ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75442026-03-03T18:55:10.994ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75452026-03-03T18:55:10.994ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75462026-03-03T18:55:10.999ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75472026-03-03T18:55:10.999ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75482026-03-03T18:55:10.999ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75492026-03-03T18:55:10.999ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
75502026-03-03T18:55:10.999ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75512026-03-03T18:55:10.999ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75522026-03-03T18:55:10.999ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75532026-03-03T18:55:10.999ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75542026-03-03T18:55:10.999ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75552026-03-03T18:55:10.999ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75562026-03-03T18:55:11.000ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572026-03-03T18:55:11.008ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ById(e879c791-c017-4ff2-8fbd-628089f569be) } result = Ok(())
75582026-03-03T18:55:11.008ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = vpc_route_manager
75592026-03-03T18:55:11.008ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75602026-03-03T18:55:11.008ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75612026-03-03T18:55:11.008ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75622026-03-03T18:55:11.009ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75632026-03-03T18:55:11.009ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75642026-03-03T18:55:11.009ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75652026-03-03T18:55:11.010ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75662026-03-03T18:55:11.010ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75672026-03-03T18:55:11.013ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75682026-03-03T18:55:11.013ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75692026-03-03T18:55:11.013ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75702026-03-03T18:55:11.013ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75712026-03-03T18:55:11.015ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75722026-03-03T18:55:11.015ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75732026-03-03T18:55:11.015ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75742026-03-03T18:55:11.016ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75752026-03-03T18:55:11.017ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75762026-03-03T18:55:11.017ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75772026-03-03T18:55:11.017ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75782026-03-03T18:55:11.017ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75792026-03-03T18:55:11.017ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75802026-03-03T18:55:11.018ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75812026-03-03T18:55:11.020ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75822026-03-03T18:55:11.020ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75832026-03-03T18:55:11.020ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75842026-03-03T18:55:11.021ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75852026-03-03T18:55:11.025ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75862026-03-03T18:55:11.025ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75872026-03-03T18:55:11.029ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75882026-03-03T18:55:11.029ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75892026-03-03T18:55:11.029ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75902026-03-03T18:55:11.029ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75912026-03-03T18:55:11.031ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ByName("default") }
75922026-03-03T18:55:11.031ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
75932026-03-03T18:55:11.031ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
75942026-03-03T18:55:11.031ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75952026-03-03T18:55:11.031ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75962026-03-03T18:55:11.032ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75972026-03-03T18:55:11.032ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75982026-03-03T18:55:11.032ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
75992026-03-03T18:55:11.032ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76002026-03-03T18:55:11.034ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
76012026-03-03T18:55:11.034ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76022026-03-03T18:55:11.034ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76032026-03-03T18:55:11.034ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76042026-03-03T18:55:11.034ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76052026-03-03T18:55:11.034ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76062026-03-03T18:55:11.034ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76072026-03-03T18:55:11.035ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76082026-03-03T18:55:11.035ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76092026-03-03T18:55:11.035ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76102026-03-03T18:55:11.037ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76112026-03-03T18:55:11.037ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76122026-03-03T18:55:11.038ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76132026-03-03T18:55:11.042ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76142026-03-03T18:55:11.042ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76152026-03-03T18:55:11.042ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76162026-03-03T18:55:11.043ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76172026-03-03T18:55:11.050ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76182026-03-03T18:55:11.055ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: e879c791-c017-4ff2-8fbd-628089f569be, lookup_type: ByName("default") } result = Ok(())
76192026-03-03T18:55:11.056ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "VpcSubnet" using built-in user background_task = vpc_route_manager
76202026-03-03T18:55:11.056ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76212026-03-03T18:55:11.056ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76222026-03-03T18:55:11.056ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76232026-03-03T18:55:11.057ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76242026-03-03T18:55:11.057ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76252026-03-03T18:55:11.057ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76262026-03-03T18:55:11.057ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76272026-03-03T18:55:11.057ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76282026-03-03T18:55:11.060ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76292026-03-03T18:55:11.060ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76302026-03-03T18:55:11.060ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76312026-03-03T18:55:11.060ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76322026-03-03T18:55:11.060ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76332026-03-03T18:55:11.060ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76342026-03-03T18:55:11.061ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76352026-03-03T18:55:11.063ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76362026-03-03T18:55:11.063ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76372026-03-03T18:55:11.063ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76382026-03-03T18:55:11.063ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76392026-03-03T18:55:11.064ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76402026-03-03T18:55:11.064ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76412026-03-03T18:55:11.064ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76422026-03-03T18:55:11.065ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76432026-03-03T18:55:11.065ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76442026-03-03T18:55:11.066ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76452026-03-03T18:55:11.066ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76462026-03-03T18:55:11.070ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76472026-03-03T18:55:11.072ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: 70e86b0c-15a8-4fcc-88bc-58f8c931f4c7, lookup_type: ByName("default") }
76482026-03-03T18:55:11.072ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
76492026-03-03T18:55:11.072ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76502026-03-03T18:55:11.072ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76512026-03-03T18:55:11.072ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76522026-03-03T18:55:11.074ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
76532026-03-03T18:55:11.074ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76542026-03-03T18:55:11.074ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76552026-03-03T18:55:11.075ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76562026-03-03T18:55:11.076ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76572026-03-03T18:55:11.076ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
76582026-03-03T18:55:11.076ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76592026-03-03T18:55:11.076ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76602026-03-03T18:55:11.077ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76612026-03-03T18:55:11.083ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 8f0c70af-b9ac-43b8-9313-8c1eb9912011, lookup_type: ById(8f0c70af-b9ac-43b8-9313-8c1eb9912011) }, key: 70e86b0c-15a8-4fcc-88bc-58f8c931f4c7, lookup_type: ByName("default") } result = Ok(())
76622026-03-03T18:55:11.083ZTRACtest_instance_metrics (BackgroundTasks): successful lookup of siloed resource "InternetGateway" using built-in user background_task = vpc_route_manager
76632026-03-03T18:55:11.083ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/vpc-routes
76642026-03-03T18:55:11.085ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44670 req_id = c0aaa9c8-5202-4a3f-bc83-029abf6ee02b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
76652026-03-03T18:55:11.085ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44670 req_id = c0aaa9c8-5202-4a3f-bc83-029abf6ee02b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
76662026-03-03T18:55:11.085ZINFOtest_instance_metrics (dropshot): request completed latency_us = 556 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44670 req_id = c0aaa9c8-5202-4a3f-bc83-029abf6ee02b response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
76672026-03-03T18:55:11.085ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 204, headers: {"x-request-id": "c0aaa9c8-5202-4a3f-bc83-029abf6ee02b", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
76682026-03-03T18:55:11.085ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 274.53509ms iteration = 3 status = {}
76692026-03-03T18:55:11.097ZINFOtest_instance_metrics (dropshot_external): set intended instance state authenticated = true changed = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 intended_state = stopped local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76702026-03-03T18:55:11.097ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76712026-03-03T18:55:11.097ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76722026-03-03T18:55:11.098ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
76732026-03-03T18:55:11.118ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
76742026-03-03T18:55:11.118ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
76752026-03-03T18:55:11.119ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
76762026-03-03T18:55:11.119ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 6 reason = Signaled
76772026-03-03T18:55:11.119ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
76782026-03-03T18:55:11.119ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
76792026-03-03T18:55:11.120ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
76802026-03-03T18:55:11.120ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: ac 77 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .w..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:63651 req_id = ee92c618-84bf-4816-ac20-b86ee5255a6b
76812026-03-03T18:55:11.120ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 44151,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:63651 req_id = ee92c618-84bf-4816-ac20-b86ee5255a6b
76822026-03-03T18:55:11.120ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
76832026-03-03T18:55:11.121ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
76842026-03-03T18:55:11.121ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:63651 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = ee92c618-84bf-4816-ac20-b86ee5255a6b
76852026-03-03T18:55:11.121ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1848, tv_nsec: 385885231 } })
76862026-03-03T18:55:11.121ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
76872026-03-03T18:55:11.121ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: be 63 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .c..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:13277 req_id = 52186cde-5ffa-4391-b009-65390463a0b3
76882026-03-03T18:55:11.121ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 48739,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:13277 req_id = 52186cde-5ffa-4391-b009-65390463a0b3
76892026-03-03T18:55:11.122ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
76902026-03-03T18:55:11.122ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:13277 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 52186cde-5ffa-4391-b009-65390463a0b3
76912026-03-03T18:55:11.139ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
76922026-03-03T18:55:11.140ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
76932026-03-03T18:55:11.140ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
76942026-03-03T18:55:11.140ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
76952026-03-03T18:55:11.140ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
76962026-03-03T18:55:11.140ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
76972026-03-03T18:55:11.141ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "9421105a-6ead-4a0b-b50c-b88af3b95ff4", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
76982026-03-03T18:55:11.141ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
76992026-03-03T18:55:11.141ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
77002026-03-03T18:55:11.141ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
77012026-03-03T18:55:11.142ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
77022026-03-03T18:55:11.143ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
77032026-03-03T18:55:11.146ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
77042026-03-03T18:55:11.146ZDEBGtest_instance_metrics (nexus): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 body = Some(Body) method = PUT uri = http://[::1]:37139/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state
77052026-03-03T18:55:11.146ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
77062026-03-03T18:55:11.146ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
77072026-03-03T18:55:11.146ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
77082026-03-03T18:55:11.146ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
77092026-03-03T18:55:11.149ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
77102026-03-03T18:55:11.150ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44672 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
77112026-03-03T18:55:11.150ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
77122026-03-03T18:55:11.150ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
77132026-03-03T18:55:11.150ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
77142026-03-03T18:55:11.150ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
77152026-03-03T18:55:11.150ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
77162026-03-03T18:55:11.151ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44672 req_id = 381e054f-7eb5-4701-b01d-7ddbe1f91d63 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state
77172026-03-03T18:55:11.151ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44672 req_id = 381e054f-7eb5-4701-b01d-7ddbe1f91d63 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state version = 23.0.0
77182026-03-03T18:55:11.152ZINFOtest_instance_metrics (SledAgent): transition action = None current = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, generation: Generation(3), time_updated: 2026-03-03T18:55:11.152086982Z }, migration_in: None, migration_out: None } desired = Some(Stopped) dropped = Some(Running) id = 4b5695ce-ffd0-4755-b762-191fd8be0384 kind = instances server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 target = Stopped
77192026-03-03T18:55:11.152ZINFOtest_instance_metrics (dropshot): request completed latency_us = 429 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44672 req_id = 381e054f-7eb5-4701-b01d-7ddbe1f91d63 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state
77202026-03-03T18:55:11.152ZDEBGtest_instance_metrics (nexus): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 result = Ok(Response { url: "http://[::1]:37139/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "381e054f-7eb5-4701-b01d-7ddbe1f91d63", "content-length": "151", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
77212026-03-03T18:55:11.152ZINFOtest_instance_metrics (dropshot_external): received new VMM runtime state from sled agent authenticated = true local_addr = 127.0.0.1:36591 method = POST migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport vmm_state = VmmRuntimeState { state: Stopping, generation: Generation(3), time_updated: 2026-03-03T18:55:11.152086982Z }
77222026-03-03T18:55:11.152ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77232026-03-03T18:55:11.153ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77242026-03-03T18:55:11.153ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77252026-03-03T18:55:11.153ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
77262026-03-03T18:55:11.153ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
77272026-03-03T18:55:11.153ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
77282026-03-03T18:55:11.153ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
77292026-03-03T18:55:11.153ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
77302026-03-03T18:55:11.157ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
77312026-03-03T18:55:11.157ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
77322026-03-03T18:55:11.157ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
77332026-03-03T18:55:11.157ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
77342026-03-03T18:55:11.159ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
77352026-03-03T18:55:11.159ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
77362026-03-03T18:55:11.159ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
77372026-03-03T18:55:11.159ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
77382026-03-03T18:55:11.159ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
77392026-03-03T18:55:11.160ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
77402026-03-03T18:55:11.160ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
77412026-03-03T18:55:11.162ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
77422026-03-03T18:55:11.162ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 42.570848ms iteration = 6 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
77432026-03-03T18:55:11.182ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77442026-03-03T18:55:11.184ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77452026-03-03T18:55:11.184ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77462026-03-03T18:55:11.184ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77472026-03-03T18:55:11.184ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77482026-03-03T18:55:11.186ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77492026-03-03T18:55:11.187ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77502026-03-03T18:55:11.187ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77512026-03-03T18:55:11.187ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77522026-03-03T18:55:11.189ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77532026-03-03T18:55:11.189ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77542026-03-03T18:55:11.189ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77552026-03-03T18:55:11.189ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77562026-03-03T18:55:11.193ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77572026-03-03T18:55:11.198ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77582026-03-03T18:55:11.198ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77592026-03-03T18:55:11.198ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77602026-03-03T18:55:11.200ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77612026-03-03T18:55:11.206ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77622026-03-03T18:55:11.206ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77632026-03-03T18:55:11.206ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77642026-03-03T18:55:11.206ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77652026-03-03T18:55:11.207ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77662026-03-03T18:55:11.209ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77672026-03-03T18:55:11.210ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77682026-03-03T18:55:11.210ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77692026-03-03T18:55:11.210ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77702026-03-03T18:55:11.211ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77712026-03-03T18:55:11.213ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 278048 local_addr = 127.0.0.1:36591 method = POST remote_addr = 127.0.0.1:46210 req_id = 76e84ef0-03d3-4267-90e1-65ded3fb190a response_code = 202 uri = /v1/instances/just-rainsticks/stop?project=springfield-squidport
77722026-03-03T18:55:11.213ZINFOtest_instance_metrics (external client test context): client received response status = 202
77732026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Action
77742026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AuditLog
77752026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AnyActor
77762026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AuthenticatedActor
77772026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = BlueprintConfig
77782026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Database
77792026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = DnsConfig
77802026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Fleet
77812026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Inventory
77822026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = IpPoolList
77832026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = VpcList
77842026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = ConsoleSessionList
77852026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = DeviceAuthRequestList
77862026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = QuiesceState
77872026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloCertificateList
77882026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloGroupList
77892026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloIdentityProviderList
77902026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloUserList
77912026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloUserSessionList
77922026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloUserTokenList
77932026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SubnetPoolList
77942026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = UpdateTrustRootList
77952026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = TargetReleaseConfig
77962026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AlertClassList
77972026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = ScimClientBearerTokenList
77982026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = MulticastGroupList
77992026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Project
78002026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Disk
78012026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Snapshot
78022026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = ProjectImage
78032026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AffinityGroup
78042026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AntiAffinityGroup
78052026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Instance
78062026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = IpPool
78072026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = InstanceNetworkInterface
78082026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Vpc
78092026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = VpcRouter
78102026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = InternetGateway
78112026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = InternetGatewayIpPool
78122026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = InternetGatewayIpAddress
78132026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = RouterRoute
78142026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = VpcSubnet
78152026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = FloatingIp
78162026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = ExternalSubnet
78172026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Image
78182026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloImage
78192026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = AddressLot
78202026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Blueprint
78212026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = LoopbackAddress
78222026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = Certificate
78232026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = ConsoleSession
78242026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = DeviceAuthRequest
78252026-03-03T18:55:11.214ZINFOtest_instance_metrics (nexus): registering Oso class class = DeviceAccessToken
78262026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = PhysicalDisk
78272026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = Rack
78282026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = SshKey
78292026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = Silo
78302026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloUser
78312026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = SiloGroup
78322026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = SupportBundle
78332026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = IdentityProvider
78342026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = SamlIdentityProvider
78352026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = Sled
78362026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = SubnetPool
78372026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = TufRepo
78382026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = TufArtifact
78392026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = TufTrustRoot
78402026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = Alert
78412026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = AlertReceiver
78422026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = WebhookSecret
78432026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = Zpool
78442026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = Service
78452026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = UserBuiltin
78462026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = ScimClientBearerToken
78472026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): registering Oso class class = MulticastGroup
78482026-03-03T18:55:11.215ZINFOtest_instance_metrics (nexus): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations; grants project.admin on all projects)\n# - silo.limited-collaborator (grants project.limited-collaborator on all projects)\n# - silo.viewer (can read most resources within the Silo; grants project.viewer)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project, including networking)\n# - project.limited-collaborator (can manage compute resources, but not networking resources)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\n# Note that certain Actors may not ever have any roles assigned to them, like\n# SCIM Actors.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif actor.is_user and silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "limited-collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t# Role hierarchy: admin > collaborator > limited-collaborator > viewer\n\t#\n\t# The "limited-collaborator" role can create/modify non-networking\n\t# resources (instances, disks, etc.) but cannot create/modify networking\n\t# infrastructure (VPCs, subnets, routers, internet gateways).\n\t# See nexus/authz-macros for InProjectLimited vs InProjectFull.\n\t"viewer" if "limited-collaborator";\n\t"limited-collaborator" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "limited-collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"limited-collaborator" if "limited-collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_user and silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n}\n# We want to allow the user to modify the ssh key but disallow a SCIM IdP token\n# from doing the same.\nhas_permission(actor: AuthenticatedActor, "modify", ssh_key: SshKey)\n\tif actor.is_user and has_permission(actor, "modify", ssh_key.silo_user);\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource ScimClientBearerToken {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n # necessary to authenticate SCIM actors\n\t"read" if "external-authenticator" on "parent_fleet";\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges for SCIM client tokens.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token: ScimClientBearerToken)\n\tif scim_client_bearer_token.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerToken)\n\tif collection.silo.fleet = fleet;\n\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the quiesce state of a particular Nexus instance.\n#\n# These authz checks must not require the database. We grant this directly to\n# callers of the internal API.\nresource QuiesceState {\n\tpermissions = [ "read", "modify" ];\n}\nhas_permission(USER_INTERNAL_API: AuthenticatedActor, "read", _q: QuiesceState);\nhas_permission(\n USER_INTERNAL_API: AuthenticatedActor,\n "modify",\n _q: QuiesceState\n);\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/update/trust-roots" in the API\nresource UpdateTrustRootList {\n\tpermissions = [ "list_children", "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"list_children" if "viewer" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: UpdateTrustRootList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif actor.is_user and silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for accessing "/v1/multicast-groups" in the API\n# Groups are created when the first instance joins and deleted when the last leaves.\nresource MulticastGroupList {\n\tpermissions = [ "list_children" ];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet Viewers can list multicast groups\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group_list: MulticastGroupList)\n\tif multicast_group_list.fleet = fleet;\n\n# Any authenticated user can list multicast groups in their fleet.\n# This enables silo users to discover groups for attaching instances,\n# without requiring the Fleet::Viewer role.\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group_list: MulticastGroupList)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group_list.fleet;\n\n# MulticastGroup is a fleet-level discovery resource.\n# Join/leave authorization is gated by Instance::Modify, not the group itself.\nresource MulticastGroup {\n\tpermissions = [ "read", "list_children" ];\n\trelations = { parent_fleet: Fleet };\n}\nhas_relation(fleet: Fleet, "parent_fleet", multicast_group: MulticastGroup)\n\tif multicast_group.fleet = fleet;\n\n# Any authenticated user can read multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "read", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Any authenticated user can list members of multicast groups in their fleet\nhas_permission(actor: AuthenticatedActor, "list_children", multicast_group: MulticastGroup)\n\tif actor.is_user and silo in actor.silo and silo.fleet = multicast_group.fleet;\n\n# Describes the policy for reading and writing the audit log\nresource AuditLog {\n\tpermissions = [\n\t "list_children", # retrieve audit log\n\t "create_child", # create audit log entry\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\n\t# Fleet viewers can read the audit log\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\n# Any actor should be able to write to the audit log because we need to be able\n# to write to the log from any request, authenticated or not. Audit log writes\n# are always a byproduct of other operations: there are no endpoints that allow\n# the user to write to the log deliberately. Note we use AuthenticatedActor\n# because we don't really mean unauthenticated -- in the case of login\n# operations, we use the external authenticator actor that creates the session\n# to authorize the audit log write.\nhas_permission(_actor: AuthenticatedActor, "create_child", _audit_log: AuditLog);\n\nhas_relation(fleet: Fleet, "parent_fleet", audit_log: AuditLog)\n\tif audit_log.fleet = fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Allow silo admins to delete and list user sessions\nresource SiloUserSessionList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's sessions.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's sessions.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserSessionList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own sessions\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserSessionList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Allow silo admins to delete and list user access tokens\nresource SiloUserTokenList {\n permissions = [ "modify", "list_children" ];\n relations = { parent_silo: Silo };\n\n # A silo admin can modify (e.g., delete) a user's tokens.\n "modify" if "admin" on "parent_silo";\n\n # A silo admin can list a user's tokens.\n "list_children" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", authn_list: SiloUserTokenList)\n if authn_list.silo_user.silo = silo;\n\n# give users 'modify' and 'list_children' on their own tokens\nhas_permission(actor: AuthenticatedActor, "modify", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\nhas_permission(actor: AuthenticatedActor, "list_children", authn_list: SiloUserTokenList)\n if actor.equals_silo_user(authn_list.silo_user);\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on users.\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_user_list: SiloUserList)\n\tif actor.is_scim_idp and silo_user_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_user: SiloUser)\n\tif actor.is_scim_idp and silo_user.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_user_list: SiloUserList)\n if actor.is_scim_idp and silo_user_list.silo in actor.silo;\n\n# Describes the policy for creating and managing Silo groups (mostly intended\n# for API-managed groups)\nresource SiloGroupList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the groups in the\n\t# Silo) can see the groups in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's groups. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloGroupList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloGroupList)\n\tif collection.silo.fleet = fleet;\n\n# Grant SCIM IdP actors the permissions they need on groups.\nhas_permission(actor: AuthenticatedActor, "read", silo_group: SiloGroup)\n if actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "create_child", silo_group_list: SiloGroupList)\n\tif actor.is_scim_idp and silo_group_list.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "modify", silo_group: SiloGroup)\n\tif actor.is_scim_idp and silo_group.silo in actor.silo;\nhas_permission(actor: AuthenticatedActor, "list_children", silo_group_list: SiloGroupList)\n if actor.is_scim_idp and silo_group_list.silo in actor.silo;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest)\n if actor.is_user;\nhas_permission(actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest)\n if actor.is_user;\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_alert_receiver: AlertReceiver };\n\n\t"read" if "read" on "parent_alert_receiver";\n\t"modify" if "modify" on "parent_alert_receiver";\n}\n\nhas_relation(rx: AlertReceiver, "parent_alert_receiver", secret: WebhookSecret)\n\tif secret.alert_receiver = rx;\n\nresource AlertClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: AlertClassList)\n\tif collection.fleet = fleet;\n\nresource ScimClientBearerTokenList {\n\tpermissions = [ "create_child", "list_children" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges for SCIM client tokens.\n # These are all admin because being able to create these tokens would allow\n # a user to grant themselves admin by modifying group membership through SCIM calls\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_silo";\n\n # Fleet-level roles also grant privileges for SCIM client tokens, for\n # configuration before silo admins are present.\n\t"create_child" if "admin" on "parent_fleet";\n\t"list_children" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", scim_client_bearer_token_list: ScimClientBearerTokenList)\n\tif scim_client_bearer_token_list.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: ScimClientBearerTokenList)\n\tif collection.silo.fleet = fleet;\n\n# VpcList is a synthetic resource for controlling VPC creation.\n# Unlike other project resources, VPC creation requires the full "collaborator"\n# role rather than "limited-collaborator", enforcing the networking restriction.\n# This allows organizations to restrict who can reconfigure the network topology\n# while still allowing users with limited-collaborator to work with compute\n# resources (instances, disks, etc.) within the existing network.\nresource VpcList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { containing_project: Project };\n\n\t"list_children" if "read" on "containing_project";\n\t"create_child" if "collaborator" on "containing_project";\n}\nhas_relation(project: Project, "containing_project", collection: VpcList)\n\tif collection.project = project;\n\n# Describes the policy for accessing "/v1/system/subnet-pools" in the API\nresource SubnetPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the Subnet Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list External Subnet Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", subnet_pool_list: SubnetPoolList)\n\tif subnet_pool_list.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource ExternalSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "limited-collaborator" on "containing_project";\n "create_child" if "limited-collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ExternalSubnet)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource SubnetPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SubnetPool)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource TufTrustRoot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufTrustRoot)\n if child.fleet = fleet;\n \n\n resource Alert {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Alert)\n if child.fleet = fleet;\n \n\n resource AlertReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AlertReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n \n\n
78492026-03-03T18:55:11.227ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78502026-03-03T18:55:11.227ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78512026-03-03T18:55:11.227ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78522026-03-03T18:55:11.229ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78532026-03-03T18:55:11.229ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78542026-03-03T18:55:11.229ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78552026-03-03T18:55:11.231ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78562026-03-03T18:55:11.231ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78572026-03-03T18:55:11.231ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78582026-03-03T18:55:11.232ZTRACtest_instance_metrics (nexus): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) }
78592026-03-03T18:55:11.232ZTRACtest_instance_metrics (nexus): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
78602026-03-03T18:55:11.233ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78612026-03-03T18:55:11.233ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78622026-03-03T18:55:11.233ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78632026-03-03T18:55:11.235ZTRACtest_instance_metrics (nexus): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
78642026-03-03T18:55:11.235ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78652026-03-03T18:55:11.235ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78662026-03-03T18:55:11.235ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78672026-03-03T18:55:11.237ZTRACtest_instance_metrics (nexus): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78682026-03-03T18:55:11.237ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78692026-03-03T18:55:11.237ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78702026-03-03T18:55:11.237ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78712026-03-03T18:55:11.239ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} }
78722026-03-03T18:55:11.244ZDEBGtest_instance_metrics (nexus): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(())
78732026-03-03T18:55:11.244ZTRACtest_instance_metrics (nexus): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) }
78742026-03-03T18:55:11.244ZTRACtest_instance_metrics (nexus): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project
78752026-03-03T18:55:11.244ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78762026-03-03T18:55:11.244ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78772026-03-03T18:55:11.245ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78782026-03-03T18:55:11.247ZTRACtest_instance_metrics (nexus): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
78792026-03-03T18:55:11.247ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78802026-03-03T18:55:11.247ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78812026-03-03T18:55:11.247ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78822026-03-03T18:55:11.249ZTRACtest_instance_metrics (nexus): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78832026-03-03T18:55:11.249ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78842026-03-03T18:55:11.249ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78852026-03-03T18:55:11.250ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78862026-03-03T18:55:11.252ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} }
78872026-03-03T18:55:11.257ZDEBGtest_instance_metrics (nexus): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(())
78882026-03-03T18:55:11.258ZTRACtest_instance_metrics (nexus): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
78892026-03-03T18:55:11.258ZDEBGtest_instance_metrics (nexus): roles roles = RoleSet { roles: {} }
78902026-03-03T18:55:11.258ZDEBGtest_instance_metrics (nexus): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
78912026-03-03T18:55:11.274ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
78922026-03-03T18:55:11.274ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
78932026-03-03T18:55:11.275ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
78942026-03-03T18:55:11.277ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) }
78952026-03-03T18:55:11.277ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
78962026-03-03T18:55:11.277ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
78972026-03-03T18:55:11.277ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
78982026-03-03T18:55:11.277ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
78992026-03-03T18:55:11.279ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
79002026-03-03T18:55:11.282ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Sled { parent: Fleet, key: b6d65341-167c-41df-9b5c-41cded99c229 (sled), lookup_type: ById(b6d65341-167c-41df-9b5c-41cded99c229) } result = Ok(())
79012026-03-03T18:55:11.285ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44674 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
79022026-03-03T18:55:11.286ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = POST remote_addr = [::1]:44674 req_id = 0a5220b4-dd04-4a90-b7ed-d3de39e7621b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/poke
79032026-03-03T18:55:11.286ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = POST remote_addr = [::1]:44674 req_id = 0a5220b4-dd04-4a90-b7ed-d3de39e7621b sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/poke version = 23.0.0
79042026-03-03T18:55:11.286ZINFOtest_instance_metrics (SledAgent): simulated transition finish action = None desired_after = Some(Stopped) id = 4b5695ce-ffd0-4755-b762-191fd8be0384 kind = instances requested_state = Some(Stopped) server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 state_after = SledVmmState { vmm_state: VmmRuntimeState { state: Running, generation: Generation(4), time_updated: 2026-03-03T18:55:11.286299507Z }, migration_in: None, migration_out: None } state_before = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, generation: Generation(3), time_updated: 2026-03-03T18:55:11.152086982Z }, migration_in: None, migration_out: None }
79052026-03-03T18:55:11.286ZDEBGtest_instance_metrics (NexusClient): client request body = Some(Body) method = PUT sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79062026-03-03T18:55:11.286ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79072026-03-03T18:55:11.286ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 version = 1.0.0
79082026-03-03T18:55:11.287ZINFOtest_instance_metrics (dropshot_internal): received new VMM runtime state from sled agent authenticated = true local_addr = 127.0.0.1:33727 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Running, generation: Generation(4), time_updated: 2026-03-03T18:55:11.286299507Z }
79092026-03-03T18:55:11.287ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79102026-03-03T18:55:11.287ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79112026-03-03T18:55:11.292ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79122026-03-03T18:55:11.298ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 11447 local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 36ddfecd-e58c-4aee-a50c-2b4a3eb7d517 response_code = 204 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79132026-03-03T18:55:11.299ZDEBGtest_instance_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384", status: 204, headers: {"x-request-id": "36ddfecd-e58c-4aee-a50c-2b4a3eb7d517", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
79142026-03-03T18:55:11.299ZINFOtest_instance_metrics (SledAgent): simulated transition finish action = None desired_after = Some(Stopped) id = 4b5695ce-ffd0-4755-b762-191fd8be0384 kind = instances requested_state = Some(Stopped) server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 state_after = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, generation: Generation(5), time_updated: 2026-03-03T18:55:11.298635047Z }, migration_in: None, migration_out: None } state_before = SledVmmState { vmm_state: VmmRuntimeState { state: Running, generation: Generation(4), time_updated: 2026-03-03T18:55:11.286299507Z }, migration_in: None, migration_out: None }
79152026-03-03T18:55:11.299ZDEBGtest_instance_metrics (NexusClient): client request body = Some(Body) method = PUT sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79162026-03-03T18:55:11.299ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79172026-03-03T18:55:11.299ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 version = 1.0.0
79182026-03-03T18:55:11.300ZINFOtest_instance_metrics (dropshot_internal): received new VMM runtime state from sled agent authenticated = true local_addr = 127.0.0.1:33727 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Stopping, generation: Generation(5), time_updated: 2026-03-03T18:55:11.298635047Z }
79192026-03-03T18:55:11.300ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79202026-03-03T18:55:11.300ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79212026-03-03T18:55:11.305ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79222026-03-03T18:55:11.306ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79232026-03-03T18:55:11.306ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79242026-03-03T18:55:11.306ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
79252026-03-03T18:55:11.307ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
79262026-03-03T18:55:11.310ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
79272026-03-03T18:55:11.310ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
79282026-03-03T18:55:11.310ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 11320 local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = f4779371-998c-4fce-a592-4a3003a5f43a response_code = 204 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79292026-03-03T18:55:11.311ZDEBGtest_instance_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384", status: 204, headers: {"x-request-id": "f4779371-998c-4fce-a592-4a3003a5f43a", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
79302026-03-03T18:55:11.311ZINFOtest_instance_metrics (SledAgent): simulated transition finish action = None desired_after = Some(Stopped) id = 4b5695ce-ffd0-4755-b762-191fd8be0384 kind = instances requested_state = Some(Stopped) server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 state_after = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, generation: Generation(6), time_updated: 2026-03-03T18:55:11.311263477Z }, migration_in: None, migration_out: None } state_before = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, generation: Generation(5), time_updated: 2026-03-03T18:55:11.298635047Z }, migration_in: None, migration_out: None }
79312026-03-03T18:55:11.311ZDEBGtest_instance_metrics (NexusClient): client request body = Some(Body) method = PUT sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79322026-03-03T18:55:11.311ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
79332026-03-03T18:55:11.311ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
79342026-03-03T18:55:11.311ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79352026-03-03T18:55:11.312ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 version = 1.0.0
79362026-03-03T18:55:11.312ZINFOtest_instance_metrics (dropshot_internal): received new VMM runtime state from sled agent authenticated = true local_addr = 127.0.0.1:33727 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Stopping, generation: Generation(6), time_updated: 2026-03-03T18:55:11.311263477Z }
79372026-03-03T18:55:11.312ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79382026-03-03T18:55:11.312ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79392026-03-03T18:55:11.313ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79402026-03-03T18:55:11.316ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 4998 local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = 906fdadf-a563-45b2-bc83-7048a27247c8 response_code = 204 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79412026-03-03T18:55:11.317ZDEBGtest_instance_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384", status: 204, headers: {"x-request-id": "906fdadf-a563-45b2-bc83-7048a27247c8", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
79422026-03-03T18:55:11.317ZINFOtest_instance_metrics (SledAgent): simulated transition finish action = Some(Destroy) desired_after = None id = 4b5695ce-ffd0-4755-b762-191fd8be0384 kind = instances requested_state = Some(Stopped) server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 state_after = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, generation: Generation(7), time_updated: 2026-03-03T18:55:11.317422967Z }, migration_in: None, migration_out: None } state_before = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, generation: Generation(6), time_updated: 2026-03-03T18:55:11.311263477Z }, migration_in: None, migration_out: None }
79432026-03-03T18:55:11.317ZINFOtest_instance_metrics (SledAgent): object is ready to destroy kind = instances object_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 server = b6d65341-167c-41df-9b5c-41cded99c229 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
79442026-03-03T18:55:11.317ZDEBGtest_instance_metrics (NexusClient): client request body = Some(Body) method = PUT sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79452026-03-03T18:55:11.317ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79462026-03-03T18:55:11.317ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 version = 1.0.0
79472026-03-03T18:55:11.318ZINFOtest_instance_metrics (dropshot_internal): received new VMM runtime state from sled agent authenticated = true local_addr = 127.0.0.1:33727 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Destroyed, generation: Generation(7), time_updated: 2026-03-03T18:55:11.317422967Z }
79482026-03-03T18:55:11.318ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79492026-03-03T18:55:11.318ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79502026-03-03T18:55:11.318ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79512026-03-03T18:55:11.326ZDEBGtest_instance_metrics (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga authenticated = true local_addr = 127.0.0.1:33727 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_needs_update = true
79522026-03-03T18:55:11.326ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79532026-03-03T18:55:11.326ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79542026-03-03T18:55:11.327ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79552026-03-03T18:55:11.328ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79562026-03-03T18:55:11.328ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79572026-03-03T18:55:11.329ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79582026-03-03T18:55:11.330ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79592026-03-03T18:55:11.330ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79602026-03-03T18:55:11.331ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79612026-03-03T18:55:11.332ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79622026-03-03T18:55:11.332ZTRACtest_instance_metrics (dropshot_internal): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79632026-03-03T18:55:11.332ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79642026-03-03T18:55:11.332ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79652026-03-03T18:55:11.333ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79662026-03-03T18:55:11.334ZTRACtest_instance_metrics (dropshot_internal): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79672026-03-03T18:55:11.334ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79682026-03-03T18:55:11.334ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79692026-03-03T18:55:11.334ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79702026-03-03T18:55:11.335ZTRACtest_instance_metrics (dropshot_internal): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79712026-03-03T18:55:11.336ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79722026-03-03T18:55:11.336ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79732026-03-03T18:55:11.336ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Database result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79742026-03-03T18:55:11.337ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79752026-03-03T18:55:11.341ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79762026-03-03T18:55:11.341ZTRACtest_instance_metrics (dropshot_internal): successful lookup of siloed resource "Instance" using built-in user authenticated = true local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79772026-03-03T18:55:11.342ZINFOtest_instance_metrics (dropshot_internal): starting update saga for 62af126f-88fe-4275-b8a4-75b87584f9b2 authenticated = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 local_addr = 127.0.0.1:33727 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002 vmm_state = VmmRuntimeState { state: Destroyed, generation: Generation(7), time_updated: 2026-03-03T18:55:11.317422967Z }
79782026-03-03T18:55:11.342ZDEBGtest_instance_metrics (dropshot_internal): preparing instance-update saga for 62af126f-88fe-4275-b8a4-75b87584f9b2... authenticated = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 type = user_builtin uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384 user_builtin_id = 001de000-05e4-4000-8000-000000000002
79792026-03-03T18:55:11.342ZINFOtest_instance_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 16196242-1779-4840-baed-8edea768d255
79802026-03-03T18:55:11.342ZINFOtest_instance_metrics (SagaExecutor): preparing saga saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update
79812026-03-03T18:55:11.342ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 24548 local_addr = 127.0.0.1:33727 method = PUT remote_addr = 127.0.0.1:36162 req_id = b4d29450-a088-4b87-9df6-9377b4458ad9 response_code = 204 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384
79822026-03-03T18:55:11.342ZINFOtest_instance_metrics (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"62af126f-88fe-4275-b8a4-75b87584f9b2","lookup_type":{"ById":"62af126f-88fe-4275-b8a4-75b87584f9b2"},"parent":{"key":"f04dd7b1-f806-4002-8222-cf99123d65c7","lookup_type":{"ById":"f04dd7b1-f806-4002-8222-cf99123d65c7"},"parent":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}},"credential_id":null,"device_token_expiration":null},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update sec_id = 913233fe-92a8-4635-9572-183f495429c4
79832026-03-03T18:55:11.342ZINFOtest_instance_metrics (SecStore): creating saga saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update
79842026-03-03T18:55:11.343ZDEBGtest_instance_metrics (NexusClient): client response result = Ok(Response { url: "http://127.0.0.1:33727/vmms/4b5695ce-ffd0-4755-b762-191fd8be0384", status: 204, headers: {"x-request-id": "b4d29450-a088-4b87-9df6-9377b4458ad9", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} }) sled_id = b6d65341-167c-41df-9b5c-41cded99c229
79852026-03-03T18:55:11.343ZINFOtest_instance_metrics (dropshot): request completed latency_us = 57659 local_addr = [::1]:37139 method = POST remote_addr = [::1]:44674 req_id = 0a5220b4-dd04-4a90-b7ed-d3de39e7621b response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vmms/4b5695ce-ffd0-4755-b762-191fd8be0384/poke
79862026-03-03T18:55:11.344ZINFOtest_instance_metrics (external client test context): waiting for instance 62af126f-88fe-4275-b8a4-75b87584f9b2 to transition to stopped...
79872026-03-03T18:55:11.344ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
79882026-03-03T18:55:11.344ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
79892026-03-03T18:55:11.344ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2 version = 2026021900.0.0
79902026-03-03T18:55:11.344ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
79912026-03-03T18:55:11.344ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
79922026-03-03T18:55:11.344ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
79932026-03-03T18:55:11.344ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
79942026-03-03T18:55:11.345ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
79952026-03-03T18:55:11.346ZINFOtest_instance_metrics (SagaExecutor): starting saga saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update
79962026-03-03T18:55:11.346ZINFOtest_instance_metrics (SEC): saga start saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update sec_id = 913233fe-92a8-4635-9572-183f495429c4
79972026-03-03T18:55:11.346ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
79982026-03-03T18:55:11.346ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 16196242-1779-4840-baed-8edea768d255
79992026-03-03T18:55:11.347ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80002026-03-03T18:55:11.347ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80012026-03-03T18:55:11.347ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80022026-03-03T18:55:11.348ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
80032026-03-03T18:55:11.348ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 16196242-1779-4840-baed-8edea768d255
80042026-03-03T18:55:11.349ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
80052026-03-03T18:55:11.349ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
80062026-03-03T18:55:11.349ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80072026-03-03T18:55:11.349ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80082026-03-03T18:55:11.350ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80092026-03-03T18:55:11.350ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
80102026-03-03T18:55:11.350ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 16196242-1779-4840-baed-8edea768d255
80112026-03-03T18:55:11.351ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80122026-03-03T18:55:11.351ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80132026-03-03T18:55:11.351ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80142026-03-03T18:55:11.351ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80152026-03-03T18:55:11.352ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
80162026-03-03T18:55:11.352ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("96f021b9-7d2e-47f4-9a3e-a00367ba4db4")) node_id = 0 saga_id = 16196242-1779-4840-baed-8edea768d255
80172026-03-03T18:55:11.352ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
80182026-03-03T18:55:11.361ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
80192026-03-03T18:55:11.361ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80202026-03-03T18:55:11.361ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80212026-03-03T18:55:11.362ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80222026-03-03T18:55:11.362ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
80232026-03-03T18:55:11.363ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 16196242-1779-4840-baed-8edea768d255
80242026-03-03T18:55:11.364ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
80252026-03-03T18:55:11.364ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
80262026-03-03T18:55:11.364ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80272026-03-03T18:55:11.364ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80282026-03-03T18:55:11.364ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80292026-03-03T18:55:11.365ZINFOtest_instance_metrics (SagaExecutor): instance update: attempting to lock instance instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update
80302026-03-03T18:55:11.365ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80312026-03-03T18:55:11.365ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80322026-03-03T18:55:11.365ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80332026-03-03T18:55:11.366ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
80342026-03-03T18:55:11.367ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
80352026-03-03T18:55:11.367ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
80362026-03-03T18:55:11.367ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
80372026-03-03T18:55:11.367ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80382026-03-03T18:55:11.367ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80392026-03-03T18:55:11.368ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80402026-03-03T18:55:11.374ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
80412026-03-03T18:55:11.378ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
80422026-03-03T18:55:11.378ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80432026-03-03T18:55:11.378ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80442026-03-03T18:55:11.378ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80452026-03-03T18:55:11.379ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80462026-03-03T18:55:11.382ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80472026-03-03T18:55:11.383ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80482026-03-03T18:55:11.383ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80492026-03-03T18:55:11.383ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80502026-03-03T18:55:11.383ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80512026-03-03T18:55:11.383ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80522026-03-03T18:55:11.384ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80532026-03-03T18:55:11.384ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80542026-03-03T18:55:11.385ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80552026-03-03T18:55:11.387ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80562026-03-03T18:55:11.387ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80572026-03-03T18:55:11.387ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80582026-03-03T18:55:11.387ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80592026-03-03T18:55:11.387ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80602026-03-03T18:55:11.389ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80612026-03-03T18:55:11.389ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80622026-03-03T18:55:11.390ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80632026-03-03T18:55:11.390ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80642026-03-03T18:55:11.392ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80652026-03-03T18:55:11.392ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80662026-03-03T18:55:11.392ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80672026-03-03T18:55:11.392ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80682026-03-03T18:55:11.392ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80692026-03-03T18:55:11.394ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80702026-03-03T18:55:11.394ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80712026-03-03T18:55:11.394ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80722026-03-03T18:55:11.394ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80732026-03-03T18:55:11.394ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80742026-03-03T18:55:11.394ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80752026-03-03T18:55:11.394ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80762026-03-03T18:55:11.395ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80772026-03-03T18:55:11.395ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
80782026-03-03T18:55:11.395ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
80792026-03-03T18:55:11.396ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80802026-03-03T18:55:11.401ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80812026-03-03T18:55:11.401ZTRACtest_instance_metrics (SagaExecutor): successful lookup of siloed resource "Instance" using built-in user authenticated = true saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80822026-03-03T18:55:11.401ZDEBGtest_instance_metrics (SagaExecutor): attempting to acquire instance updater lock authenticated = true current_gen = Generation(Generation(1)) instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin updater_id = 96f021b9-7d2e-47f4-9a3e-a00367ba4db4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
80832026-03-03T18:55:11.401ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80842026-03-03T18:55:11.401ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80852026-03-03T18:55:11.402ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
80862026-03-03T18:55:11.402ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80872026-03-03T18:55:11.403ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80882026-03-03T18:55:11.403ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80892026-03-03T18:55:11.403ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80902026-03-03T18:55:11.405ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
80912026-03-03T18:55:11.405ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
80922026-03-03T18:55:11.405ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
80932026-03-03T18:55:11.405ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
80942026-03-03T18:55:11.405ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80952026-03-03T18:55:11.410ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80962026-03-03T18:55:11.410ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80972026-03-03T18:55:11.410ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80982026-03-03T18:55:11.410ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
80992026-03-03T18:55:11.410ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81002026-03-03T18:55:11.411ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81012026-03-03T18:55:11.411ZDEBGtest_instance_metrics (SagaExecutor): attempting to acquire instance updater lock authenticated = true current_gen = Generation(Generation(1)) instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin updater_id = 96f021b9-7d2e-47f4-9a3e-a00367ba4db4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
81022026-03-03T18:55:11.411ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81032026-03-03T18:55:11.411ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81042026-03-03T18:55:11.413ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81052026-03-03T18:55:11.413ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
81062026-03-03T18:55:11.415ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81072026-03-03T18:55:11.415ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81082026-03-03T18:55:11.415ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81092026-03-03T18:55:11.415ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81102026-03-03T18:55:11.416ZDEBGtest_instance_metrics (SagaExecutor): instance updater lock acquired! already_locked = true authenticated = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 locked_gen = Generation(Generation(2)) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = LockInstance type = user_builtin updater_id = 96f021b9-7d2e-47f4-9a3e-a00367ba4db4 user_builtin_id = 001de000-05e4-4000-8000-000000000002
81112026-03-03T18:55:11.416ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81122026-03-03T18:55:11.416ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("96f021b9-7d2e-47f4-9a3e-a00367ba4db4")}) node_id = 1 saga_id = 16196242-1779-4840-baed-8edea768d255
81132026-03-03T18:55:11.418ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81142026-03-03T18:55:11.418ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 16196242-1779-4840-baed-8edea768d255
81152026-03-03T18:55:11.418ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81162026-03-03T18:55:11.418ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81172026-03-03T18:55:11.419ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81182026-03-03T18:55:11.419ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81192026-03-03T18:55:11.420ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81202026-03-03T18:55:11.420ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81212026-03-03T18:55:11.421ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81222026-03-03T18:55:11.421ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81232026-03-03T18:55:11.421ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81242026-03-03T18:55:11.421ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81252026-03-03T18:55:11.426ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81262026-03-03T18:55:11.426ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81272026-03-03T18:55:11.426ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81282026-03-03T18:55:11.426ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81292026-03-03T18:55:11.429ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81302026-03-03T18:55:11.429ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81312026-03-03T18:55:11.430ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81322026-03-03T18:55:11.430ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81332026-03-03T18:55:11.431ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 86543 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 2024dfb3-f9d3-4354-92b3-227c8c76e550 response_code = 200 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
81342026-03-03T18:55:11.431ZINFOtest_instance_metrics (external client test context): client received response status = 200
81352026-03-03T18:55:11.431ZINFOtest_instance_metrics (external client test context): instance 62af126f-88fe-4275-b8a4-75b87584f9b2 has not transitioned to stopped instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 instance_runtime_state = InstanceRuntimeState { run_state: Stopping, time_run_state_updated: 2026-03-03T18:55:11.317422Z, time_last_auto_restarted: None }
81362026-03-03T18:55:11.431ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81372026-03-03T18:55:11.431ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81382026-03-03T18:55:11.431ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81392026-03-03T18:55:11.432ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81402026-03-03T18:55:11.433ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81412026-03-03T18:55:11.437ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81422026-03-03T18:55:11.438ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81432026-03-03T18:55:11.438ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81442026-03-03T18:55:11.438ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81452026-03-03T18:55:11.443ZINFOtest_instance_metrics (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 4b5695ce-ffd0-4755-b762-191fd8be0384, time_created: 2026-03-03T18:55:10.033378Z, time_deleted: None, instance_id: 62af126f-88fe-4275-b8a4-75b87584f9b2, sled_id: b6d65341-167c-41df-9b5c-41cded99c229 (sled), propolis_ip: V6(Ipv6Network { addr: ::1:0, prefix: 128 }), propolis_port: SqlU16(12400), cpu_platform: AmdMilan, runtime: VmmRuntimeState { time_state_updated: 2026-03-03T18:55:11.317422Z, generation: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2026-03-03T18:55:09.423319Z, generation: Generation(Generation(3)), propolis_id: Some(4b5695ce-ffd0-4755-b762-191fd8be0384), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(4b5695ce-ffd0-4755-b762-191fd8be0384 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2026-03-03T18:55:11.443650899Z, generation: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
81462026-03-03T18:55:11.443ZINFOtest_instance_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81472026-03-03T18:55:11.443ZINFOtest_instance_metrics (SagaExecutor): preparing saga saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
81482026-03-03T18:55:11.444ZINFOtest_instance_metrics (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"62af126f-88fe-4275-b8a4-75b87584f9b2","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}},"credential_id":null,"device_token_expiration":null},null]}},"vmm_id":"4b5695ce-ffd0-4755-b762-191fd8be0384"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"62af126f-88fe-4275-b8a4-75b87584f9b2","lookup_type":{"ById":"62af126f-88fe-4275-b8a4-75b87584f9b2"},"parent":{"key":"f04dd7b1-f806-4002-8222-cf99123d65c7","lookup_type":{"ById":"f04dd7b1-f806-4002-8222-cf99123d65c7"},"parent":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"96f021b9-7d2e-47f4-9a3e-a00367ba4db4"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}},"credential_id":null,"device_token_expiration":null},null]}},"update":{"deprovision":{"cpus_diff":4,"project_id":"f04dd7b1-f806-4002-8222-cf99123d65c7","ram_diff":1073741824},"destroy_active_vmm":"4b5695ce-ffd0-4755-b762-191fd8be0384","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2026-03-03T18:55:11.443650899Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update sec_id = 913233fe-92a8-4635-9572-183f495429c4
81492026-03-03T18:55:11.444ZINFOtest_instance_metrics (SecStore): creating saga saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
81502026-03-03T18:55:11.446ZINFOtest_instance_metrics (SagaExecutor): starting saga saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
81512026-03-03T18:55:11.446ZINFOtest_instance_metrics (SEC): saga start saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update sec_id = 913233fe-92a8-4635-9572-183f495429c4
81522026-03-03T18:55:11.446ZDEBGtest_instance_metrics (SEC): saga log event new_state = N013 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81532026-03-03T18:55:11.446ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81542026-03-03T18:55:11.447ZDEBGtest_instance_metrics (SEC): saga log event new_state = N013 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81552026-03-03T18:55:11.447ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81562026-03-03T18:55:11.449ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81572026-03-03T18:55:11.449ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81582026-03-03T18:55:11.450ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81592026-03-03T18:55:11.450ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("1664aded-6ca3-46ce-b8db-eecf0e3b1191")) node_id = 0 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81602026-03-03T18:55:11.451ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81612026-03-03T18:55:11.451ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81622026-03-03T18:55:11.452ZDEBGtest_instance_metrics (SagaExecutor): instance update: trying to become instance updater... instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 parent_lock = UpdaterLock { updater_id: 96f021b9-7d2e-47f4-9a3e-a00367ba4db4, locked_gen: Generation(Generation(2)) } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
81632026-03-03T18:55:11.452ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = BecomeUpdater type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81642026-03-03T18:55:11.452ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = BecomeUpdater type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81652026-03-03T18:55:11.453ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = BecomeUpdater type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81662026-03-03T18:55:11.457ZDEBGtest_instance_metrics (SagaExecutor): inherited lock from 96f021b9-7d2e-47f4-9a3e-a00367ba4db4 to 1664aded-6ca3-46ce-b8db-eecf0e3b1191 authenticated = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 96f021b9-7d2e-47f4-9a3e-a00367ba4db4 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = BecomeUpdater type = user_builtin updater_id = 1664aded-6ca3-46ce-b8db-eecf0e3b1191 user_builtin_id = 001de000-05e4-4000-8000-000000000002
81672026-03-03T18:55:11.457ZINFOtest_instance_metrics (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
81682026-03-03T18:55:11.457ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81692026-03-03T18:55:11.457ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1664aded-6ca3-46ce-b8db-eecf0e3b1191")}) node_id = 1 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81702026-03-03T18:55:11.458ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81712026-03-03T18:55:11.458ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81722026-03-03T18:55:11.460ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
81732026-03-03T18:55:11.460ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81742026-03-03T18:55:11.461ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
81752026-03-03T18:55:11.461ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
81762026-03-03T18:55:11.463ZINFOtest_instance_metrics (SagaExecutor): instance update: deleting network config instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
81772026-03-03T18:55:11.463ZINFOtest_instance_metrics (nexus): deleting instance dpd configuration instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2
81782026-03-03T18:55:11.463ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81792026-03-03T18:55:11.463ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81802026-03-03T18:55:11.463ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81812026-03-03T18:55:11.465ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81822026-03-03T18:55:11.465ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81832026-03-03T18:55:11.465ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81842026-03-03T18:55:11.469ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81852026-03-03T18:55:11.469ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81862026-03-03T18:55:11.469ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UpdateNetworkConfig type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
81872026-03-03T18:55:11.479ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
81882026-03-03T18:55:11.479ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
81892026-03-03T18:55:11.479ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
81902026-03-03T18:55:11.479ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
81912026-03-03T18:55:11.480ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
81922026-03-03T18:55:11.481ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
81932026-03-03T18:55:11.483ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
81942026-03-03T18:55:11.483ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
81952026-03-03T18:55:11.483ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
81962026-03-03T18:55:11.484ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
81972026-03-03T18:55:11.486ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
81982026-03-03T18:55:11.486ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 65 25 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 e%..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:52386 req_id = bb86ecb8-e890-4889-b5e4-14ef6ae2f32f
81992026-03-03T18:55:11.486ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 25893,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:52386 req_id = bb86ecb8-e890-4889-b5e4-14ef6ae2f32f
82002026-03-03T18:55:11.486ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
82012026-03-03T18:55:11.487ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
82022026-03-03T18:55:11.487ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:52386 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = bb86ecb8-e890-4889-b5e4-14ef6ae2f32f
82032026-03-03T18:55:11.487ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1848, tv_nsec: 751869867 } })
82042026-03-03T18:55:11.487ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
82052026-03-03T18:55:11.487ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: b3 ec 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:59403 req_id = d8cea7a6-3611-4919-87d1-74ffdd00a03a
82062026-03-03T18:55:11.487ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46060,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59403 req_id = d8cea7a6-3611-4919-87d1-74ffdd00a03a
82072026-03-03T18:55:11.487ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
82082026-03-03T18:55:11.487ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:59403 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = d8cea7a6-3611-4919-87d1-74ffdd00a03a
82092026-03-03T18:55:11.510ZTRACtest_instance_metrics (DpdClient): client request body = None method = GET uri = http://[::1]:39131/switch/identifiers
82102026-03-03T18:55:11.511ZTRACtest_instance_metrics (DpdClient): client response result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fc5ecc6-1762-405a-a1a2-f4981daefaac", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
82112026-03-03T18:55:11.514ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82122026-03-03T18:55:11.514ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82132026-03-03T18:55:11.518ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82142026-03-03T18:55:11.518ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82152026-03-03T18:55:11.520ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ReleaseVirtualProvisioning type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82162026-03-03T18:55:11.520ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ReleaseVirtualProvisioning type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82172026-03-03T18:55:11.521ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ReleaseVirtualProvisioning type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82182026-03-03T18:55:11.527ZINFOtest_instance_metrics (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2026-03-03T18:55:11.522663Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(0)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 001de000-5110-4000-8000-000000000000, time_modified: Some(2026-03-03T18:55:11.522663Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(0)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f04dd7b1-f806-4002-8222-cf99123d65c7, time_modified: Some(2026-03-03T18:55:11.522663Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(0)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
82192026-03-03T18:55:11.527ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82202026-03-03T18:55:11.527ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82212026-03-03T18:55:11.529ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82222026-03-03T18:55:11.529ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82232026-03-03T18:55:11.530ZINFOtest_instance_metrics (SagaExecutor): instance update (no VMM): unassigning oximeter producer instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
82242026-03-03T18:55:11.530ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UnassignOximeterProducer type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82252026-03-03T18:55:11.530ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UnassignOximeterProducer type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82262026-03-03T18:55:11.531ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = UnassignOximeterProducer type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82272026-03-03T18:55:11.532ZTRACtest_instance_metrics (SagaExecutor): un-assigned non-existent metric producer producer_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
82282026-03-03T18:55:11.532ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82292026-03-03T18:55:11.532ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82302026-03-03T18:55:11.534ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82312026-03-03T18:55:11.534ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82322026-03-03T18:55:11.535ZDEBGtest_instance_metrics (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 lock = UpdaterLock { updater_id: 1664aded-6ca3-46ce-b8db-eecf0e3b1191, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2026-03-03T18:55:11.443650899Z, generation: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
82332026-03-03T18:55:11.535ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = CommitInstanceUpdates type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82342026-03-03T18:55:11.535ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = CommitInstanceUpdates type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82352026-03-03T18:55:11.536ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = CommitInstanceUpdates type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82362026-03-03T18:55:11.539ZINFOtest_instance_metrics (SagaExecutor): instance update: committed update new runtime state! did_unlock = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 new_runtime = InstanceRuntimeState { time_updated: 2026-03-03T18:55:11.443650899Z, generation: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
82372026-03-03T18:55:11.539ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Signaled
82382026-03-03T18:55:11.539ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
82392026-03-03T18:55:11.539ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82402026-03-03T18:55:11.540ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
82412026-03-03T18:55:11.540ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Signaled
82422026-03-03T18:55:11.540ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
82432026-03-03T18:55:11.540ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
82442026-03-03T18:55:11.540ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82452026-03-03T18:55:11.540ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
82462026-03-03T18:55:11.540ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82472026-03-03T18:55:11.541ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82482026-03-03T18:55:11.541ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82492026-03-03T18:55:11.541ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82502026-03-03T18:55:11.543ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82512026-03-03T18:55:11.543ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82522026-03-03T18:55:11.543ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82532026-03-03T18:55:11.546ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82542026-03-03T18:55:11.546ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
82552026-03-03T18:55:11.546ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
82562026-03-03T18:55:11.546ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
82572026-03-03T18:55:11.546ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82582026-03-03T18:55:11.546ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82592026-03-03T18:55:11.547ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82602026-03-03T18:55:11.551ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82612026-03-03T18:55:11.551ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
82622026-03-03T18:55:11.551ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82632026-03-03T18:55:11.551ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82642026-03-03T18:55:11.551ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82652026-03-03T18:55:11.551ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}, "credential_id": Null, "device_token_expiration": Null}, Null]}}, "vmm_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384")}) node_id = 7 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82662026-03-03T18:55:11.551ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
82672026-03-03T18:55:11.551ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82682026-03-03T18:55:11.552ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
82692026-03-03T18:55:11.554ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82702026-03-03T18:55:11.554ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82712026-03-03T18:55:11.564ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
82722026-03-03T18:55:11.564ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:37139/vpc-routes
82732026-03-03T18:55:11.564ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44676 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
82742026-03-03T18:55:11.565ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44676 req_id = 375011b7-a292-40eb-9ef9-bc52ef0a3399 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
82752026-03-03T18:55:11.565ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44676 req_id = 375011b7-a292-40eb-9ef9-bc52ef0a3399 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
82762026-03-03T18:55:11.565ZINFOtest_instance_metrics (dropshot): request completed latency_us = 237 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44676 req_id = 375011b7-a292-40eb-9ef9-bc52ef0a3399 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
82772026-03-03T18:55:11.565ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "375011b7-a292-40eb-9ef9-bc52ef0a3399", "content-length": "214", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
82782026-03-03T18:55:11.565ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
82792026-03-03T18:55:11.565ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82802026-03-03T18:55:11.566ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82812026-03-03T18:55:11.571ZDEBGtest_instance_metrics (SEC): saga log event new_state = N008 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82822026-03-03T18:55:11.571ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82832026-03-03T18:55:11.577ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
82842026-03-03T18:55:11.577ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82852026-03-03T18:55:11.581ZINFOtest_instance_metrics (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
82862026-03-03T18:55:11.581ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ReleaseSledResources type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82872026-03-03T18:55:11.581ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ReleaseSledResources type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82882026-03-03T18:55:11.582ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ReleaseSledResources type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
82892026-03-03T18:55:11.597ZINFOtest_instance_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
82902026-03-03T18:55:11.597ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/eip-gateways
82912026-03-03T18:55:11.597ZDEBGtest_instance_metrics (SEC): saga log event new_state = N009 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
82922026-03-03T18:55:11.597ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
82932026-03-03T18:55:11.598ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44676 req_id = 6c1da3d8-273a-4fe8-a239-b0fd59ee7100 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
82942026-03-03T18:55:11.598ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44676 req_id = 6c1da3d8-273a-4fe8-a239-b0fd59ee7100 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
82952026-03-03T18:55:11.598ZINFOtest_instance_metrics (dropshot): request completed latency_us = 318 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44676 req_id = 6c1da3d8-273a-4fe8-a239-b0fd59ee7100 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
82962026-03-03T18:55:11.599ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/eip-gateways", status: 204, headers: {"x-request-id": "6c1da3d8-273a-4fe8-a239-b0fd59ee7100", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
82972026-03-03T18:55:11.599ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
82982026-03-03T18:55:11.599ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82992026-03-03T18:55:11.599ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83002026-03-03T18:55:11.600ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83012026-03-03T18:55:11.600ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83022026-03-03T18:55:11.606ZINFOtest_instance_metrics (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 propolis_id = 4b5695ce-ffd0-4755-b762-191fd8be0384 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
83032026-03-03T18:55:11.606ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = MarkVmmDeleted type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83042026-03-03T18:55:11.606ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = MarkVmmDeleted type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83052026-03-03T18:55:11.607ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = MarkVmmDeleted type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83062026-03-03T18:55:11.607ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
83072026-03-03T18:55:11.607ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83082026-03-03T18:55:11.608ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83092026-03-03T18:55:11.610ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
83102026-03-03T18:55:11.610ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83112026-03-03T18:55:11.611ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83122026-03-03T18:55:11.611ZDEBGtest_instance_metrics (SEC): saga log event new_state = N010 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83132026-03-03T18:55:11.611ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83142026-03-03T18:55:11.615ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83152026-03-03T18:55:11.615ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83162026-03-03T18:55:11.616ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 push not needed background_task = vpc_route_manager
83172026-03-03T18:55:11.616ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/vpc-routes
83182026-03-03T18:55:11.616ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44676 req_id = 47c67c13-85b2-48d8-9665-ee348e683542 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
83192026-03-03T18:55:11.616ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44676 req_id = 47c67c13-85b2-48d8-9665-ee348e683542 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
83202026-03-03T18:55:11.625ZINFOtest_instance_metrics (dropshot): request completed latency_us = 8524 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44676 req_id = 47c67c13-85b2-48d8-9665-ee348e683542 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
83212026-03-03T18:55:11.625ZDEBGtest_instance_metrics (SEC): saga log event new_state = N011 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83222026-03-03T18:55:11.625ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83232026-03-03T18:55:11.626ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 204, headers: {"x-request-id": "47c67c13-85b2-48d8-9665-ee348e683542", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
83242026-03-03T18:55:11.626ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 85.402617ms iteration = 4 status = {}
83252026-03-03T18:55:11.628ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83262026-03-03T18:55:11.628ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83272026-03-03T18:55:11.630ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83282026-03-03T18:55:11.630ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83292026-03-03T18:55:11.630ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83302026-03-03T18:55:11.630ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83312026-03-03T18:55:11.631ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83322026-03-03T18:55:11.632ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83332026-03-03T18:55:11.632ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83342026-03-03T18:55:11.632ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83352026-03-03T18:55:11.633ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83362026-03-03T18:55:11.634ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83372026-03-03T18:55:11.634ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83382026-03-03T18:55:11.634ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83392026-03-03T18:55:11.634ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83402026-03-03T18:55:11.636ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83412026-03-03T18:55:11.641ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83422026-03-03T18:55:11.641ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83432026-03-03T18:55:11.641ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83442026-03-03T18:55:11.641ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true resource = Database result = Ok(()) saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_node = ChainSuccessorSaga type = user_builtin user_builtin_id = 001de000-05e4-4000-8000-000000000002
83452026-03-03T18:55:11.648ZDEBGtest_instance_metrics (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 intended_state = stopped karmic_state = WillReincarnate needs_reincarnation = false saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update
83462026-03-03T18:55:11.648ZDEBGtest_instance_metrics (SEC): saga log event new_state = N012 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83472026-03-03T18:55:11.648ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83482026-03-03T18:55:11.656ZDEBGtest_instance_metrics (SEC): saga log event new_state = N014 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83492026-03-03T18:55:11.656ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83502026-03-03T18:55:11.658ZDEBGtest_instance_metrics (SEC): saga log event new_state = N014 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83512026-03-03T18:55:11.658ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83522026-03-03T18:55:11.660ZINFOtest_instance_metrics (SEC): update for saga cached state new_state = Done saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 sec_id = 913233fe-92a8-4635-9572-183f495429c4
83532026-03-03T18:55:11.660ZINFOtest_instance_metrics (SecStore): updating state new_state = done saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83542026-03-03T18:55:11.670ZINFOtest_instance_metrics (SEC): saga finished result = success saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update sec_id = 913233fe-92a8-4635-9572-183f495429c4
83552026-03-03T18:55:11.670ZINFOtest_instance_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948
83562026-03-03T18:55:11.670ZINFOtest_instance_metrics (SagaExecutor): saga finished saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 saga_name = instance-update saga_result = SagaResult { saga_id: 7e53799f-76f0-4dc2-9782-5cb0ba8b7948, saga_log: SagaLog { saga_id: 7e53799f-76f0-4dc2-9782-5cb0ba8b7948, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("1664aded-6ca3-46ce-b8db-eecf0e3b1191")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1664aded-6ca3-46ce-b8db-eecf0e3b1191")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}, "credential_id": Null, "device_token_expiration": Null}, Null]}}, "vmm_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("62af126f-88fe-4275-b8a4-75b87584f9b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}, "credential_id": Null, "device_token_expiration": Null}, Null]}}, "vmm_id": String("4b5695ce-ffd0-4755-b762-191fd8be0384")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("1664aded-6ca3-46ce-b8db-eecf0e3b1191"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("1664aded-6ca3-46ce-b8db-eecf0e3b1191")}} }) }
83572026-03-03T18:55:11.670ZDEBGtest_instance_metrics (SagaExecutor): instance update: child saga completed successfully child_saga_id = 7e53799f-76f0-4dc2-9782-5cb0ba8b7948 instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update
83582026-03-03T18:55:11.670ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83592026-03-03T18:55:11.670ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 16196242-1779-4840-baed-8edea768d255
83602026-03-03T18:55:11.673ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
83612026-03-03T18:55:11.673ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
83622026-03-03T18:55:11.673ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
83632026-03-03T18:55:11.673ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83642026-03-03T18:55:11.674ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
83652026-03-03T18:55:11.675ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
83662026-03-03T18:55:11.675ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 16196242-1779-4840-baed-8edea768d255
83672026-03-03T18:55:11.676ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83682026-03-03T18:55:11.679ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83692026-03-03T18:55:11.679ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
83702026-03-03T18:55:11.679ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
83712026-03-03T18:55:11.679ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
83722026-03-03T18:55:11.679ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83732026-03-03T18:55:11.679ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
83742026-03-03T18:55:11.681ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
83752026-03-03T18:55:11.681ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 16196242-1779-4840-baed-8edea768d255
83762026-03-03T18:55:11.681ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83772026-03-03T18:55:11.684ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83782026-03-03T18:55:11.684ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
83792026-03-03T18:55:11.684ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83802026-03-03T18:55:11.685ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
83812026-03-03T18:55:11.686ZINFOtest_instance_metrics (SEC): update for saga cached state new_state = Done saga_id = 16196242-1779-4840-baed-8edea768d255 sec_id = 913233fe-92a8-4635-9572-183f495429c4
83822026-03-03T18:55:11.686ZINFOtest_instance_metrics (SecStore): updating state new_state = done saga_id = 16196242-1779-4840-baed-8edea768d255
83832026-03-03T18:55:11.696ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:37139/v2p
83842026-03-03T18:55:11.697ZINFOtest_instance_metrics (SEC): saga finished result = success saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update sec_id = 913233fe-92a8-4635-9572-183f495429c4
83852026-03-03T18:55:11.697ZINFOtest_instance_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 16196242-1779-4840-baed-8edea768d255
83862026-03-03T18:55:11.697ZINFOtest_instance_metrics (SagaExecutor): saga finished saga_id = 16196242-1779-4840-baed-8edea768d255 saga_name = start-instance-update saga_result = SagaResult { saga_id: 16196242-1779-4840-baed-8edea768d255, saga_log: SagaLog { saga_id: 16196242-1779-4840-baed-8edea768d255, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("96f021b9-7d2e-47f4-9a3e-a00367ba4db4")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("96f021b9-7d2e-47f4-9a3e-a00367ba4db4")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("96f021b9-7d2e-47f4-9a3e-a00367ba4db4"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("96f021b9-7d2e-47f4-9a3e-a00367ba4db4")}} }) }
83872026-03-03T18:55:11.697ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 7 reason = Signaled
83882026-03-03T18:55:11.697ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
83892026-03-03T18:55:11.697ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
83902026-03-03T18:55:11.697ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
83912026-03-03T18:55:11.698ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44678 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
83922026-03-03T18:55:11.698ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44678 req_id = 563a75e1-d44e-4769-8c10-3dae63de2fdc sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
83932026-03-03T18:55:11.698ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44678 req_id = 563a75e1-d44e-4769-8c10-3dae63de2fdc sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
83942026-03-03T18:55:11.698ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: b6 89 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 ............._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:53314 req_id = 23b54012-195e-4c00-8a56-cba4ac0d2493
83952026-03-03T18:55:11.698ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46729,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:53314 req_id = 23b54012-195e-4c00-8a56-cba4ac0d2493
83962026-03-03T18:55:11.698ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
83972026-03-03T18:55:11.699ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
83982026-03-03T18:55:11.699ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:53314 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 23b54012-195e-4c00-8a56-cba4ac0d2493
83992026-03-03T18:55:11.699ZINFOtest_instance_metrics (dropshot): request completed latency_us = 726 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44678 req_id = 563a75e1-d44e-4769-8c10-3dae63de2fdc response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
84002026-03-03T18:55:11.699ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1848, tv_nsec: 964073897 } })
84012026-03-03T18:55:11.699ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
84022026-03-03T18:55:11.699ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:37139/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "563a75e1-d44e-4769-8c10-3dae63de2fdc", "content-length": "103", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
84032026-03-03T18:55:11.699ZINFOtest_instance_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: ::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014) }} sled = SimGimlet00
84042026-03-03T18:55:11.699ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [VirtualNetworkInterfaceHost { physical_host_ip: ::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13437014) }] sled = SimGimlet00
84052026-03-03T18:55:11.699ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = Some(Body) method = DELETE uri = http://[::1]:37139/v2p
84062026-03-03T18:55:11.700ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = DELETE remote_addr = [::1]:44678 req_id = 3295d3f8-66cf-4603-924d-2d638203a576 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
84072026-03-03T18:55:11.700ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = DELETE remote_addr = [::1]:44678 req_id = 3295d3f8-66cf-4603-924d-2d638203a576 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
84082026-03-03T18:55:11.700ZINFOtest_instance_metrics (dropshot): request completed latency_us = 210 local_addr = [::1]:37139 method = DELETE remote_addr = [::1]:44678 req_id = 3295d3f8-66cf-4603-924d-2d638203a576 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
84092026-03-03T18:55:11.700ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: da 6a 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .j..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:24680 req_id = 8507cc8a-b4a7-4d3f-8c3e-aa9c235dc888
84102026-03-03T18:55:11.700ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 55914,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:24680 req_id = 8507cc8a-b4a7-4d3f-8c3e-aa9c235dc888
84112026-03-03T18:55:11.700ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
84122026-03-03T18:55:11.700ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:24680 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 8507cc8a-b4a7-4d3f-8c3e-aa9c235dc888
84132026-03-03T18:55:11.700ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:37139/v2p", status: 204, headers: {"x-request-id": "3295d3f8-66cf-4603-924d-2d638203a576", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
84142026-03-03T18:55:11.700ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = SimGimlet00
84152026-03-03T18:55:11.700ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 161.013618ms iteration = 3 status = {}
84162026-03-03T18:55:11.719ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
84172026-03-03T18:55:11.720ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "a89af789-a553-4f91-811c-5900d302e2c3", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:11 GMT"} })
84182026-03-03T18:55:11.720ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
84192026-03-03T18:55:11.720ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
84202026-03-03T18:55:11.720ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
84212026-03-03T18:55:11.720ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
84222026-03-03T18:55:11.722ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
84232026-03-03T18:55:11.722ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
84242026-03-03T18:55:11.722ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
84252026-03-03T18:55:11.722ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
84262026-03-03T18:55:11.723ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
84272026-03-03T18:55:11.725ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
84282026-03-03T18:55:11.725ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
84292026-03-03T18:55:11.725ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
84302026-03-03T18:55:11.725ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
84312026-03-03T18:55:11.725ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
84322026-03-03T18:55:11.727ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
84332026-03-03T18:55:11.727ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
84342026-03-03T18:55:11.727ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
84352026-03-03T18:55:11.727ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
84362026-03-03T18:55:11.728ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
84372026-03-03T18:55:11.729ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
84382026-03-03T18:55:11.729ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
84392026-03-03T18:55:11.729ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
84402026-03-03T18:55:11.730ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
84412026-03-03T18:55:11.731ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
84422026-03-03T18:55:11.731ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
84432026-03-03T18:55:11.731ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
84442026-03-03T18:55:11.731ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
84452026-03-03T18:55:11.732ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
84462026-03-03T18:55:11.733ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
84472026-03-03T18:55:11.733ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
84482026-03-03T18:55:11.734ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
84492026-03-03T18:55:11.734ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 36.916889ms iteration = 7 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
84502026-03-03T18:55:11.803ZTRACtest_instance_metrics (dns): buffer buffer = Length: 67 (0x43) bytes\n0000: b6 ff 01 00 00 01 00 00 00 00 00 01 04 5f 6d 67 ............._mg\n0010: 73 04 5f 74 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 s._tcp.control-p\n0020: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0030: 6e 61 6c 00 00 21 00 01 00 00 29 04 d0 00 00 00 nal..!....).....\n0040: 00 00 00 ... kind = dns peer_addr = [::1]:59866 req_id = 7cfdfdfd-d3ff-4dfc-a531-02e7a8c0aa63
84512026-03-03T18:55:11.803ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 46847,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_mgs._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_mgs._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 4,\n 95,\n 109,\n 103,\n 115,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:59866 req_id = 7cfdfdfd-d3ff-4dfc-a531-02e7a8c0aa63
84522026-03-03T18:55:11.804ZDEBGtest_instance_metrics (store): query key key = _mgs._tcp
84532026-03-03T18:55:11.804ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
84542026-03-03T18:55:11.804ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:59866 query = LowerQuery { name: LowerName(Name("_mgs._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 35581, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = 7cfdfdfd-d3ff-4dfc-a531-02e7a8c0aa63
84552026-03-03T18:55:11.804ZTRACtest_instance_metrics (dns): buffer buffer = Length: 74 (0x4a) bytes\n0000: 26 28 01 00 00 01 00 00 00 00 00 01 0b 5f 72 65 &(..........._re\n0010: 70 6f 2d 64 65 70 6f 74 04 5f 74 63 70 0d 63 6f po-depot._tcp.co\n0020: 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 ntrol-plane.oxid\n0030: 65 08 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 e.internal..!...\n0040: 00 29 04 d0 00 00 00 00 00 00 .)........ kind = dns peer_addr = [::1]:58210 req_id = f22a6480-686b-4cba-a650-aeaf61c69a85
84562026-03-03T18:55:11.804ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 9768,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_repo-depot._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_repo-depot._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 11,\n 95,\n 114,\n 101,\n 112,\n 111,\n 45,\n 100,\n 101,\n 112,\n 111,\n 116,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:58210 req_id = f22a6480-686b-4cba-a650-aeaf61c69a85
84572026-03-03T18:55:11.804ZDEBGtest_instance_metrics (store): query key key = _repo-depot._tcp
84582026-03-03T18:55:11.804ZDEBGtest_instance_metrics (store): query key key = b6d65341-167c-41df-9b5c-41cded99c229.sled
84592026-03-03T18:55:11.804ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:58210 query = LowerQuery { name: LowerName(Name("_repo-depot._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_repo-depot._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_repo-depot._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 41667, target: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal") }) }] req_id = f22a6480-686b-4cba-a650-aeaf61c69a85
84602026-03-03T18:55:11.804ZTRACtest_instance_metrics (dns): buffer buffer = Length: 79 (0x4f) bytes\n0000: 7e 86 01 00 00 01 00 00 00 00 00 01 10 5f 63 72 ~............_cr\n0010: 75 63 69 62 6c 65 2d 70 61 6e 74 72 79 04 5f 74 ucible-pantry._t\n0020: 63 70 0d 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 cp.control-plane\n0030: 05 6f 78 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 .oxide.internal.\n0040: 00 21 00 01 00 00 29 04 d0 00 00 00 00 00 00 .!....)........ kind = dns peer_addr = [::1]:64113 req_id = 7abeca3a-2215-4be7-b50c-54758006f94f
84612026-03-03T18:55:11.804ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 32390,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 16,\n 95,\n 99,\n 114,\n 117,\n 99,\n 105,\n 98,\n 108,\n 101,\n 45,\n 112,\n 97,\n 110,\n 116,\n 114,\n 121,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:64113 req_id = 7abeca3a-2215-4be7-b50c-54758006f94f
84622026-03-03T18:55:11.804ZDEBGtest_instance_metrics (store): query key key = _crucible-pantry._tcp
84632026-03-03T18:55:11.804ZDEBGtest_instance_metrics (store): query key key = fc4a94aa-404a-4070-a9aa-bb9c3603902d.host
84642026-03-03T18:55:11.804ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:64113 query = LowerQuery { name: LowerName(Name("_crucible-pantry._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_crucible-pantry._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 37499, target: Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal") }) }] req_id = 7abeca3a-2215-4be7-b50c-54758006f94f
84652026-03-03T18:55:11.805ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: e7 6e 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .n..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:58536 req_id = 6e5b1e17-c362-41bc-a423-b7f67459cbbe
84662026-03-03T18:55:11.805ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 59246,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:58536 req_id = 6e5b1e17-c362-41bc-a423-b7f67459cbbe
84672026-03-03T18:55:11.805ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
84682026-03-03T18:55:11.805ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:58536 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 6e5b1e17-c362-41bc-a423-b7f67459cbbe
84692026-03-03T18:55:11.805ZTRACtest_instance_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 83 bc 01 00 00 01 00 00 00 00 00 01 24 62 36 64 ............$b6d\n0010: 36 35 33 34 31 2d 31 36 37 63 2d 34 31 64 66 2d 65341-167c-41df-\n0020: 39 62 35 63 2d 34 31 63 64 65 64 39 39 63 32 32 9b5c-41cded99c22\n0030: 39 04 73 6c 65 64 0d 63 6f 6e 74 72 6f 6c 2d 70 9.sled.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:57091 req_id = ce9c34f3-bdc2-4dbe-9ecd-c86ffef93d35
84702026-03-03T18:55:11.805ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 33724,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 115,\n 108,\n 101,\n 100,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:57091 req_id = ce9c34f3-bdc2-4dbe-9ecd-c86ffef93d35
84712026-03-03T18:55:11.805ZDEBGtest_instance_metrics (store): query key key = b6d65341-167c-41df-9b5c-41cded99c229.sled
84722026-03-03T18:55:11.805ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:57091 query = LowerQuery { name: LowerName(Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal.")), original: Query { name: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("b6d65341-167c-41df-9b5c-41cded99c229.sled.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = ce9c34f3-bdc2-4dbe-9ecd-c86ffef93d35
84732026-03-03T18:55:11.805ZTRACtest_instance_metrics (dns): buffer buffer = Length: 99 (0x63) bytes\n0000: 61 19 01 00 00 01 00 00 00 00 00 01 24 66 63 34 a...........$fc4\n0010: 61 39 34 61 61 2d 34 30 34 61 2d 34 30 37 30 2d a94aa-404a-4070-\n0020: 61 39 61 61 2d 62 62 39 63 33 36 30 33 39 30 32 a9aa-bb9c3603902\n0030: 64 04 68 6f 73 74 0d 63 6f 6e 74 72 6f 6c 2d 70 d.host.control-p\n0040: 6c 61 6e 65 05 6f 78 69 64 65 08 69 6e 74 65 72 lane.oxide.inter\n0050: 6e 61 6c 00 00 1c 00 01 00 00 29 04 d0 00 00 00 nal.......).....\n0060: 00 00 00 ... kind = dns peer_addr = [::1]:50874 req_id = 528dd941-b448-4506-8b58-6598516d797b
84742026-03-03T18:55:11.805ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 24857,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 36,\n 102,\n 99,\n 52,\n 97,\n 57,\n 52,\n 97,\n 97,\n 45,\n 52,\n 48,\n 52,\n 97,\n 45,\n 52,\n 48,\n 55,\n 48,\n 45,\n 97,\n 57,\n 97,\n 97,\n 45,\n 98,\n 98,\n 57,\n 99,\n 51,\n 54,\n 48,\n 51,\n 57,\n 48,\n 50,\n 100,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:50874 req_id = 528dd941-b448-4506-8b58-6598516d797b
84752026-03-03T18:55:11.805ZDEBGtest_instance_metrics (store): query key key = fc4a94aa-404a-4070-a9aa-bb9c3603902d.host
84762026-03-03T18:55:11.805ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:50874 query = LowerQuery { name: LowerName(Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal.")), original: Query { name: Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("fc4a94aa-404a-4070-a9aa-bb9c3603902d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 528dd941-b448-4506-8b58-6598516d797b
84772026-03-03T18:55:11.832ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52640 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84782026-03-03T18:55:11.833ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52640 req_id = c3521b70-0cd1-4830-899b-bf41e0c941e1 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84792026-03-03T18:55:11.833ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 197 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52640 req_id = c3521b70-0cd1-4830-899b-bf41e0c941e1 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84802026-03-03T18:55:11.964ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52642 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84812026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52644 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84822026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52646 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84832026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52648 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84842026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52650 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84852026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52652 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84862026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): accepted connection kind = pantry local_addr = [::1]:37499 remote_addr = [::1]:52654 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
84872026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52642 req_id = 13cdd5a3-046b-46d7-838f-f7767dca0b19 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84882026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52644 req_id = e341a2f1-9d69-4066-87f2-2ae0b0397804 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84892026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52646 req_id = 23aca6d0-8701-43ed-bd18-0290d80cfe46 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84902026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52648 req_id = 71b2d3fb-6c77-4bc9-8005-069ace9880b5 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84912026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52650 req_id = 2e12fa9d-329e-4925-a59c-51aaaa1b7be2 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84922026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52652 req_id = f2614544-9417-4b98-9116-a9ddb49cc789 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84932026-03-03T18:55:11.965ZTRACtest_instance_metrics (dropshot): incoming request kind = pantry local_addr = [::1]:37499 method = GET remote_addr = [::1]:52654 req_id = 415ce939-58df-44af-a048-305b5c702471 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84942026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 341 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52642 req_id = 13cdd5a3-046b-46d7-838f-f7767dca0b19 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84952026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 312 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52644 req_id = e341a2f1-9d69-4066-87f2-2ae0b0397804 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84962026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 302 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52646 req_id = 23aca6d0-8701-43ed-bd18-0290d80cfe46 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84972026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 291 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52648 req_id = 71b2d3fb-6c77-4bc9-8005-069ace9880b5 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84982026-03-03T18:55:11.965ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 275 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52650 req_id = 2e12fa9d-329e-4925-a59c-51aaaa1b7be2 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
84992026-03-03T18:55:11.966ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 266 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52652 req_id = f2614544-9417-4b98-9116-a9ddb49cc789 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
85002026-03-03T18:55:11.966ZINFOtest_instance_metrics (dropshot): request completed kind = pantry latency_us = 250 local_addr = [::1]:37499 method = GET remote_addr = [::1]:52654 req_id = 415ce939-58df-44af-a048-305b5c702471 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /crucible/pantry/0
85012026-03-03T18:55:12.312ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85022026-03-03T18:55:12.312ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85032026-03-03T18:55:12.313ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
85042026-03-03T18:55:12.315ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
85052026-03-03T18:55:12.315ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
85062026-03-03T18:55:12.315ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
85072026-03-03T18:55:12.316ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
85082026-03-03T18:55:12.316ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
85092026-03-03T18:55:12.386ZINFOtest_instance_metrics (oximeter-agent): refreshing list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:557
85102026-03-03T18:55:12.388ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
85112026-03-03T18:55:12.388ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = f6a4b3c4-57de-45ec-a3d1-8388c1bf3710 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
85122026-03-03T18:55:12.388ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = f6a4b3c4-57de-45ec-a3d1-8388c1bf3710 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending version = 1.0.0
85132026-03-03T18:55:12.388ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = f6a4b3c4-57de-45ec-a3d1-8388c1bf3710 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
85142026-03-03T18:55:12.388ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = f6a4b3c4-57de-45ec-a3d1-8388c1bf3710 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
85152026-03-03T18:55:12.388ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = f6a4b3c4-57de-45ec-a3d1-8388c1bf3710 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending user_builtin_id = 001de000-05e4-4000-8000-000000000002
85162026-03-03T18:55:12.389ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 2853 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = f6a4b3c4-57de-45ec-a3d1-8388c1bf3710 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending
85172026-03-03T18:55:12.390ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6a4b3c4-57de-45ec-a3d1-8388c1bf3710", "content-length": "405", "date": "Tue, 03 Mar 2026 18:55:12 GMT"} })
85182026-03-03T18:55:12.390ZDEBGtest_instance_metrics (oximeter): client request body = None method = GET uri = http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
85192026-03-03T18:55:12.391ZTRACtest_instance_metrics (dropshot_internal): incoming request local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = a0035d66-2037-442a-bf6f-4aaf6350b992 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
85202026-03-03T18:55:12.391ZDEBGtest_instance_metrics (dropshot_internal): determined request API version local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = a0035d66-2037-442a-bf6f-4aaf6350b992 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D version = 1.0.0
85212026-03-03T18:55:12.391ZTRACtest_instance_metrics (dropshot_internal): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = a0035d66-2037-442a-bf6f-4aaf6350b992 resource = Database type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
85222026-03-03T18:55:12.391ZDEBGtest_instance_metrics (dropshot_internal): roles authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = a0035d66-2037-442a-bf6f-4aaf6350b992 roles = RoleSet { roles: {} } type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
85232026-03-03T18:55:12.391ZDEBGtest_instance_metrics (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) authenticated = true local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = a0035d66-2037-442a-bf6f-4aaf6350b992 resource = Database result = Ok(()) type = user_builtin uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D user_builtin_id = 001de000-05e4-4000-8000-000000000002
85242026-03-03T18:55:12.397ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
85252026-03-03T18:55:12.397ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
85262026-03-03T18:55:12.399ZINFOtest_instance_metrics (dropshot_internal): request completed latency_us = 8782 local_addr = 127.0.0.1:33727 method = GET remote_addr = 127.0.0.1:36168 req_id = a0035d66-2037-442a-bf6f-4aaf6350b992 response_code = 200 uri = /metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D
85272026-03-03T18:55:12.401ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
85282026-03-03T18:55:12.401ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
85292026-03-03T18:55:12.401ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
85302026-03-03T18:55:12.401ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
85312026-03-03T18:55:12.401ZDEBGtest_instance_metrics (oximeter): client response result = Ok(Response { url: "http://127.0.0.1:33727/metrics/collectors/39e6175b-4df2-4730-b11d-cbc1e60a2e78/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhNjQ1OGI3ZC04N2MzLTQ0ODMtYmU5Ni04NTRkODE0YzIwZGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0035d66-2037-442a-bf6f-4aaf6350b992", "content-length": "29", "date": "Tue, 03 Mar 2026 18:55:12 GMT"} })
85322026-03-03T18:55:12.401ZTRACtest_instance_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4
85332026-03-03T18:55:12.401ZTRACtest_instance_metrics (oximeter-agent): ignoring request to update existing metric producer, since the endpoint information is the same as the existing collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de
85342026-03-03T18:55:12.401ZINFOtest_instance_metrics (oximeter-agent): refreshed list of producers from Nexus collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
85352026-03-03T18:55:12.413ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
85362026-03-03T18:55:12.432ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85372026-03-03T18:55:12.433ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85382026-03-03T18:55:12.433ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2 version = 2026021900.0.0
85392026-03-03T18:55:12.433ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85402026-03-03T18:55:12.433ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85412026-03-03T18:55:12.433ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85422026-03-03T18:55:12.433ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85432026-03-03T18:55:12.433ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85442026-03-03T18:55:12.435ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85452026-03-03T18:55:12.437ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85462026-03-03T18:55:12.437ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85472026-03-03T18:55:12.437ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
85482026-03-03T18:55:12.437ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
85492026-03-03T18:55:12.437ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85502026-03-03T18:55:12.437ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85512026-03-03T18:55:12.437ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85522026-03-03T18:55:12.439ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85532026-03-03T18:55:12.439ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85542026-03-03T18:55:12.439ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85552026-03-03T18:55:12.439ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85562026-03-03T18:55:12.440ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
85572026-03-03T18:55:12.442ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
85582026-03-03T18:55:12.442ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85592026-03-03T18:55:12.442ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85602026-03-03T18:55:12.443ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85612026-03-03T18:55:12.444ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
85622026-03-03T18:55:12.444ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
85632026-03-03T18:55:12.444ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85642026-03-03T18:55:12.444ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85652026-03-03T18:55:12.444ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85662026-03-03T18:55:12.446ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
85672026-03-03T18:55:12.448ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
85682026-03-03T18:55:12.448ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
85692026-03-03T18:55:12.448ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
85702026-03-03T18:55:12.448ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
85712026-03-03T18:55:12.449ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
85722026-03-03T18:55:12.449ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85732026-03-03T18:55:12.449ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85742026-03-03T18:55:12.449ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85752026-03-03T18:55:12.450ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85762026-03-03T18:55:12.451ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85772026-03-03T18:55:12.451ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85782026-03-03T18:55:12.451ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85792026-03-03T18:55:12.452ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85802026-03-03T18:55:12.452ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85812026-03-03T18:55:12.453ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85822026-03-03T18:55:12.454ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85832026-03-03T18:55:12.454ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85842026-03-03T18:55:12.454ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85852026-03-03T18:55:12.454ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85862026-03-03T18:55:12.455ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85872026-03-03T18:55:12.456ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85882026-03-03T18:55:12.456ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85892026-03-03T18:55:12.456ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85902026-03-03T18:55:12.457ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85912026-03-03T18:55:12.458ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85922026-03-03T18:55:12.458ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85932026-03-03T18:55:12.458ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85942026-03-03T18:55:12.459ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85952026-03-03T18:55:12.460ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85962026-03-03T18:55:12.465ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85972026-03-03T18:55:12.466ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85982026-03-03T18:55:12.466ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
85992026-03-03T18:55:12.466ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86002026-03-03T18:55:12.466ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86012026-03-03T18:55:12.466ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86022026-03-03T18:55:12.467ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86032026-03-03T18:55:12.467ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86042026-03-03T18:55:12.467ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86052026-03-03T18:55:12.467ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86062026-03-03T18:55:12.469ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86072026-03-03T18:55:12.470ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86082026-03-03T18:55:12.470ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86092026-03-03T18:55:12.470ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86102026-03-03T18:55:12.471ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86112026-03-03T18:55:12.476ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86122026-03-03T18:55:12.476ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86132026-03-03T18:55:12.476ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86142026-03-03T18:55:12.476ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86152026-03-03T18:55:12.478ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 45820 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ddebef9b-628c-48fd-b9e7-370a570fabec response_code = 200 uri = /v1/instances/62af126f-88fe-4275-b8a4-75b87584f9b2
86162026-03-03T18:55:12.480ZINFOtest_instance_metrics (external client test context): client received response status = 200
86172026-03-03T18:55:12.480ZINFOtest_instance_metrics (external client test context): instance 62af126f-88fe-4275-b8a4-75b87584f9b2 has transitioned to stopped
86182026-03-03T18:55:12.480ZTRACtest_instance_metrics: authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
86192026-03-03T18:55:12.480ZDEBGtest_instance_metrics: roles roles = RoleSet { roles: {} }
86202026-03-03T18:55:12.480ZDEBGtest_instance_metrics: authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
86212026-03-03T18:55:12.481ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86222026-03-03T18:55:12.481ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86232026-03-03T18:55:12.481ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86242026-03-03T18:55:12.481ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86252026-03-03T18:55:12.481ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86262026-03-03T18:55:12.481ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86272026-03-03T18:55:12.481ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86282026-03-03T18:55:12.481ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86292026-03-03T18:55:12.481ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1 version = 2026021900.0.0
86302026-03-03T18:55:12.482ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 21582895-aba3-49e4-95e4-7a98505fd5bf uri = /913233fe-92a8-4635-9572-183f495429c4
86312026-03-03T18:55:12.482ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86322026-03-03T18:55:12.482ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86332026-03-03T18:55:12.482ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86342026-03-03T18:55:12.482ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86352026-03-03T18:55:12.482ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86362026-03-03T18:55:12.489ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7504 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 21582895-aba3-49e4-95e4-7a98505fd5bf response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
86372026-03-03T18:55:12.490ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86382026-03-03T18:55:12.500ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86392026-03-03T18:55:12.500ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86402026-03-03T18:55:12.500ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
86412026-03-03T18:55:12.500ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86422026-03-03T18:55:12.500ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86432026-03-03T18:55:12.500ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86442026-03-03T18:55:12.500ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
86452026-03-03T18:55:12.501ZDEBGtest_instance_metrics (results-sink): inserting 29 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86462026-03-03T18:55:12.501ZDEBGtest_instance_metrics (results-sink-cluster): inserting 29 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
86472026-03-03T18:55:12.501ZDEBGtest_instance_metrics (clickhouse-client): unrolling 29 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
86482026-03-03T18:55:12.510ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 34 sql = INSERT INTO oximeter.fields_string FORMAT Native
86492026-03-03T18:55:12.511ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86502026-03-03T18:55:12.511ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86512026-03-03T18:55:12.511ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86522026-03-03T18:55:12.512ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
86532026-03-03T18:55:12.512ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
86542026-03-03T18:55:12.512ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86552026-03-03T18:55:12.512ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86562026-03-03T18:55:12.513ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86572026-03-03T18:55:12.514ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 34 table_name = fields_string
86582026-03-03T18:55:12.514ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
86592026-03-03T18:55:12.514ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86602026-03-03T18:55:12.514ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86612026-03-03T18:55:12.514ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86622026-03-03T18:55:12.515ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86632026-03-03T18:55:12.517ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
86642026-03-03T18:55:12.517ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 22 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
86652026-03-03T18:55:12.517ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
86662026-03-03T18:55:12.518ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
86672026-03-03T18:55:12.518ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86682026-03-03T18:55:12.518ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86692026-03-03T18:55:12.519ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86702026-03-03T18:55:12.520ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
86712026-03-03T18:55:12.521ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
86722026-03-03T18:55:12.521ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86732026-03-03T18:55:12.521ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86742026-03-03T18:55:12.521ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86752026-03-03T18:55:12.521ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 22 table_name = fields_uuid
86762026-03-03T18:55:12.521ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
86772026-03-03T18:55:12.522ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
86782026-03-03T18:55:12.522ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
86792026-03-03T18:55:12.522ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
86802026-03-03T18:55:12.522ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
86812026-03-03T18:55:12.524ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
86822026-03-03T18:55:12.525ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
86832026-03-03T18:55:12.526ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86842026-03-03T18:55:12.526ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86852026-03-03T18:55:12.526ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86862026-03-03T18:55:12.526ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86872026-03-03T18:55:12.526ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86882026-03-03T18:55:12.526ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86892026-03-03T18:55:12.526ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
86902026-03-03T18:55:12.526ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 13 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
86912026-03-03T18:55:12.528ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86922026-03-03T18:55:12.528ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86932026-03-03T18:55:12.528ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86942026-03-03T18:55:12.528ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86952026-03-03T18:55:12.530ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86962026-03-03T18:55:12.531ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86972026-03-03T18:55:12.531ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86982026-03-03T18:55:12.531ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
86992026-03-03T18:55:12.531ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87002026-03-03T18:55:12.532ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87012026-03-03T18:55:12.532ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87022026-03-03T18:55:12.532ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 13 table_name = measurements_i64
87032026-03-03T18:55:12.532ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87042026-03-03T18:55:12.532ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87052026-03-03T18:55:12.532ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
87062026-03-03T18:55:12.533ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
87072026-03-03T18:55:12.535ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87082026-03-03T18:55:12.535ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87092026-03-03T18:55:12.535ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87102026-03-03T18:55:12.535ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87112026-03-03T18:55:12.536ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
87122026-03-03T18:55:12.536ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
87132026-03-03T18:55:12.536ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87142026-03-03T18:55:12.538ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87152026-03-03T18:55:12.539ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
87162026-03-03T18:55:12.544ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.481147749' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
87172026-03-03T18:55:12.544ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
87182026-03-03T18:55:12.544ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87192026-03-03T18:55:12.550ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 67859 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 698c0641-63ed-49db-9596-8423e5a7c799 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.481147749Z&order=descending&limit=1
87202026-03-03T18:55:12.550ZINFOtest_instance_metrics (external client test context): client received response status = 200
87212026-03-03T18:55:12.550ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87222026-03-03T18:55:12.550ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87232026-03-03T18:55:12.550ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87242026-03-03T18:55:12.550ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87252026-03-03T18:55:12.550ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87262026-03-03T18:55:12.550ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87272026-03-03T18:55:12.551ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87282026-03-03T18:55:12.551ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87292026-03-03T18:55:12.551ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1 version = 2026021900.0.0
87302026-03-03T18:55:12.551ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 69cc2ec5-34aa-4ae3-9da1-9cf7e87daa90 uri = /913233fe-92a8-4635-9572-183f495429c4
87312026-03-03T18:55:12.551ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87322026-03-03T18:55:12.553ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87332026-03-03T18:55:12.553ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87342026-03-03T18:55:12.553ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87352026-03-03T18:55:12.553ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87362026-03-03T18:55:12.559ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7778 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 69cc2ec5-34aa-4ae3-9da1-9cf7e87daa90 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
87372026-03-03T18:55:12.559ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87382026-03-03T18:55:12.567ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87392026-03-03T18:55:12.568ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87402026-03-03T18:55:12.568ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
87412026-03-03T18:55:12.568ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87422026-03-03T18:55:12.568ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87432026-03-03T18:55:12.568ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87442026-03-03T18:55:12.568ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
87452026-03-03T18:55:12.568ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87462026-03-03T18:55:12.568ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
87472026-03-03T18:55:12.573ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
87482026-03-03T18:55:12.574ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87492026-03-03T18:55:12.574ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87502026-03-03T18:55:12.575ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87512026-03-03T18:55:12.576ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
87522026-03-03T18:55:12.576ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
87532026-03-03T18:55:12.577ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
87542026-03-03T18:55:12.577ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
87552026-03-03T18:55:12.577ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87562026-03-03T18:55:12.577ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87572026-03-03T18:55:12.577ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87582026-03-03T18:55:12.578ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
87592026-03-03T18:55:12.578ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
87602026-03-03T18:55:12.578ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
87612026-03-03T18:55:12.579ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87622026-03-03T18:55:12.579ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87632026-03-03T18:55:12.579ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87642026-03-03T18:55:12.580ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
87652026-03-03T18:55:12.581ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
87662026-03-03T18:55:12.581ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
87672026-03-03T18:55:12.583ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
87682026-03-03T18:55:12.583ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87692026-03-03T18:55:12.583ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87702026-03-03T18:55:12.583ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87712026-03-03T18:55:12.584ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
87722026-03-03T18:55:12.584ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
87732026-03-03T18:55:12.584ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87742026-03-03T18:55:12.584ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87752026-03-03T18:55:12.585ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87762026-03-03T18:55:12.585ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
87772026-03-03T18:55:12.585ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87782026-03-03T18:55:12.585ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87792026-03-03T18:55:12.586ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
87802026-03-03T18:55:12.586ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
87812026-03-03T18:55:12.586ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
87822026-03-03T18:55:12.586ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
87832026-03-03T18:55:12.586ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
87842026-03-03T18:55:12.587ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
87852026-03-03T18:55:12.588ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
87862026-03-03T18:55:12.588ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
87872026-03-03T18:55:12.589ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
87882026-03-03T18:55:12.591ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
87892026-03-03T18:55:12.592ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87902026-03-03T18:55:12.592ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87912026-03-03T18:55:12.592ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87922026-03-03T18:55:12.592ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87932026-03-03T18:55:12.592ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87942026-03-03T18:55:12.592ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87952026-03-03T18:55:12.595ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
87962026-03-03T18:55:12.595ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
87972026-03-03T18:55:12.597ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87982026-03-03T18:55:12.597ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
87992026-03-03T18:55:12.597ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88002026-03-03T18:55:12.597ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88012026-03-03T18:55:12.599ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88022026-03-03T18:55:12.600ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88032026-03-03T18:55:12.600ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88042026-03-03T18:55:12.601ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88052026-03-03T18:55:12.601ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88062026-03-03T18:55:12.601ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88072026-03-03T18:55:12.601ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88082026-03-03T18:55:12.602ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
88092026-03-03T18:55:12.602ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88102026-03-03T18:55:12.603ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88112026-03-03T18:55:12.603ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88122026-03-03T18:55:12.603ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88132026-03-03T18:55:12.603ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88142026-03-03T18:55:12.608ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88152026-03-03T18:55:12.610ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88162026-03-03T18:55:12.612ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
88172026-03-03T18:55:12.615ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.550591380' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
88182026-03-03T18:55:12.617ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 66438 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 0fcaab42-0d2b-462e-9379-87876885302f response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.550591380Z&order=descending&limit=1
88192026-03-03T18:55:12.617ZINFOtest_instance_metrics (external client test context): client received response status = 200
88202026-03-03T18:55:12.618ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88212026-03-03T18:55:12.618ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88222026-03-03T18:55:12.618ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88232026-03-03T18:55:12.618ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88242026-03-03T18:55:12.618ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88252026-03-03T18:55:12.618ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88262026-03-03T18:55:12.618ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88272026-03-03T18:55:12.618ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88282026-03-03T18:55:12.618ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1 version = 2026021900.0.0
88292026-03-03T18:55:12.618ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = aa5fa6b7-7815-4e99-876c-d1227fdaf295 uri = /913233fe-92a8-4635-9572-183f495429c4
88302026-03-03T18:55:12.619ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88312026-03-03T18:55:12.619ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88322026-03-03T18:55:12.619ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88332026-03-03T18:55:12.619ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88342026-03-03T18:55:12.619ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88352026-03-03T18:55:12.626ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7191 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = aa5fa6b7-7815-4e99-876c-d1227fdaf295 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
88362026-03-03T18:55:12.626ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88372026-03-03T18:55:12.634ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88382026-03-03T18:55:12.634ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88392026-03-03T18:55:12.634ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
88402026-03-03T18:55:12.634ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88412026-03-03T18:55:12.634ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88422026-03-03T18:55:12.635ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88432026-03-03T18:55:12.635ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
88442026-03-03T18:55:12.635ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88452026-03-03T18:55:12.635ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
88462026-03-03T18:55:12.640ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
88472026-03-03T18:55:12.640ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88482026-03-03T18:55:12.640ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88492026-03-03T18:55:12.641ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88502026-03-03T18:55:12.642ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
88512026-03-03T18:55:12.643ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
88522026-03-03T18:55:12.643ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88532026-03-03T18:55:12.643ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88542026-03-03T18:55:12.643ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88552026-03-03T18:55:12.644ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
88562026-03-03T18:55:12.644ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
88572026-03-03T18:55:12.645ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88582026-03-03T18:55:12.645ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88592026-03-03T18:55:12.645ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88602026-03-03T18:55:12.645ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88612026-03-03T18:55:12.647ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
88622026-03-03T18:55:12.647ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
88632026-03-03T18:55:12.647ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
88642026-03-03T18:55:12.649ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
88652026-03-03T18:55:12.649ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88662026-03-03T18:55:12.649ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88672026-03-03T18:55:12.649ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88682026-03-03T18:55:12.650ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
88692026-03-03T18:55:12.652ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
88702026-03-03T18:55:12.652ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88712026-03-03T18:55:12.652ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88722026-03-03T18:55:12.652ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88732026-03-03T18:55:12.652ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
88742026-03-03T18:55:12.652ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
88752026-03-03T18:55:12.652ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
88762026-03-03T18:55:12.652ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
88772026-03-03T18:55:12.653ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
88782026-03-03T18:55:12.653ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
88792026-03-03T18:55:12.653ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
88802026-03-03T18:55:12.655ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
88812026-03-03T18:55:12.655ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88822026-03-03T18:55:12.655ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88832026-03-03T18:55:12.655ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88842026-03-03T18:55:12.655ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88852026-03-03T18:55:12.656ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88862026-03-03T18:55:12.656ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88872026-03-03T18:55:12.656ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
88882026-03-03T18:55:12.658ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88892026-03-03T18:55:12.658ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
88902026-03-03T18:55:12.658ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
88912026-03-03T18:55:12.658ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
88922026-03-03T18:55:12.658ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88932026-03-03T18:55:12.658ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88942026-03-03T18:55:12.658ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88952026-03-03T18:55:12.659ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88962026-03-03T18:55:12.660ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
88972026-03-03T18:55:12.660ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
88982026-03-03T18:55:12.660ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
88992026-03-03T18:55:12.662ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89002026-03-03T18:55:12.662ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89012026-03-03T18:55:12.662ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89022026-03-03T18:55:12.662ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89032026-03-03T18:55:12.662ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89042026-03-03T18:55:12.662ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89052026-03-03T18:55:12.664ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89062026-03-03T18:55:12.664ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89072026-03-03T18:55:12.664ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89082026-03-03T18:55:12.664ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89092026-03-03T18:55:12.666ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89102026-03-03T18:55:12.668ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89112026-03-03T18:55:12.671ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
89122026-03-03T18:55:12.671ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
89132026-03-03T18:55:12.671ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
89142026-03-03T18:55:12.672ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.618064079' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
89152026-03-03T18:55:12.677ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 59160 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d692dd4b-81d7-4693-a030-f2912564bc3f response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.618064079Z&order=descending&limit=1
89162026-03-03T18:55:12.678ZINFOtest_instance_metrics (external client test context): client received response status = 200
89172026-03-03T18:55:12.678ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
89182026-03-03T18:55:12.678ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89192026-03-03T18:55:12.678ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89202026-03-03T18:55:12.678ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89212026-03-03T18:55:12.678ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89222026-03-03T18:55:12.678ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89232026-03-03T18:55:12.678ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89242026-03-03T18:55:12.680ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
89252026-03-03T18:55:12.680ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
89262026-03-03T18:55:12.680ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 11f404e3-0b96-4983-9c23-09d4e9ecb94a uri = /913233fe-92a8-4635-9572-183f495429c4
89272026-03-03T18:55:12.680ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
89282026-03-03T18:55:12.680ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
89292026-03-03T18:55:12.680ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89302026-03-03T18:55:12.680ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89312026-03-03T18:55:12.680ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89322026-03-03T18:55:12.686ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7352 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 11f404e3-0b96-4983-9c23-09d4e9ecb94a response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
89332026-03-03T18:55:12.686ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89342026-03-03T18:55:12.695ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89352026-03-03T18:55:12.695ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89362026-03-03T18:55:12.696ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
89372026-03-03T18:55:12.696ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89382026-03-03T18:55:12.696ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89392026-03-03T18:55:12.696ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89402026-03-03T18:55:12.696ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
89412026-03-03T18:55:12.696ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
89422026-03-03T18:55:12.696ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
89432026-03-03T18:55:12.701ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
89442026-03-03T18:55:12.701ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89452026-03-03T18:55:12.701ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89462026-03-03T18:55:12.701ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89472026-03-03T18:55:12.702ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = reconfigurator_config_watcher iteration = 3 reason = Timeout
89482026-03-03T18:55:12.702ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig
89492026-03-03T18:55:12.702ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = reconfigurator_config_watcher resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89502026-03-03T18:55:12.702ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
89512026-03-03T18:55:12.702ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
89522026-03-03T18:55:12.703ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
89532026-03-03T18:55:12.704ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
89542026-03-03T18:55:12.704ZDEBGtest_instance_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
89552026-03-03T18:55:12.704ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
89562026-03-03T18:55:12.704ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
89572026-03-03T18:55:12.704ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89582026-03-03T18:55:12.704ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89592026-03-03T18:55:12.704ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89602026-03-03T18:55:12.705ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612026-03-03T18:55:12.708ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = BlueprintConfig result = Ok(())
89622026-03-03T18:55:12.708ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database
89632026-03-03T18:55:12.708ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = reconfigurator_config_watcher roles = RoleSet { roles: {} }
89642026-03-03T18:55:12.709ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = reconfigurator_config_watcher resource = Database result = Ok(())
89652026-03-03T18:55:12.713ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
89662026-03-03T18:55:12.713ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
89672026-03-03T18:55:12.713ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89682026-03-03T18:55:12.713ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89692026-03-03T18:55:12.713ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89702026-03-03T18:55:12.713ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89712026-03-03T18:55:12.713ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
89722026-03-03T18:55:12.713ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
89732026-03-03T18:55:12.713ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
89742026-03-03T18:55:12.713ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
89752026-03-03T18:55:12.714ZDEBGtest_instance_metrics (BackgroundTasks): reconfigurator config load complete background_task = reconfigurator_config_watcher switches = Loaded(ReconfiguratorConfigView { version: 1, config: ReconfiguratorConfig { planner_enabled: false, planner_config: PlannerConfig { add_zones_with_mupdate_override: false }, tuf_repo_pruner_enabled: true }, time_modified: 2026-03-03T18:55:02.625804Z })
89762026-03-03T18:55:12.714ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = reconfigurator_config_watcher elapsed = 11.502588ms iteration = 3 status = {"config_updated":false}
89772026-03-03T18:55:12.714ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
89782026-03-03T18:55:12.716ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
89792026-03-03T18:55:12.716ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89802026-03-03T18:55:12.716ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89812026-03-03T18:55:12.717ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89822026-03-03T18:55:12.718ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
89832026-03-03T18:55:12.718ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
89842026-03-03T18:55:12.718ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89852026-03-03T18:55:12.718ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89862026-03-03T18:55:12.718ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89872026-03-03T18:55:12.719ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
89882026-03-03T18:55:12.719ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
89892026-03-03T18:55:12.719ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
89902026-03-03T18:55:12.719ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
89912026-03-03T18:55:12.720ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
89922026-03-03T18:55:12.721ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
89932026-03-03T18:55:12.721ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
89942026-03-03T18:55:12.721ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
89952026-03-03T18:55:12.721ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
89962026-03-03T18:55:12.722ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
89972026-03-03T18:55:12.722ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
89982026-03-03T18:55:12.722ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
89992026-03-03T18:55:12.724ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
90002026-03-03T18:55:12.724ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90012026-03-03T18:55:12.724ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90022026-03-03T18:55:12.724ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90032026-03-03T18:55:12.724ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90042026-03-03T18:55:12.724ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90052026-03-03T18:55:12.725ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90062026-03-03T18:55:12.725ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
90072026-03-03T18:55:12.725ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
90082026-03-03T18:55:12.726ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90092026-03-03T18:55:12.726ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90102026-03-03T18:55:12.727ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90112026-03-03T18:55:12.727ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90122026-03-03T18:55:12.728ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90132026-03-03T18:55:12.730ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90142026-03-03T18:55:12.730ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90152026-03-03T18:55:12.730ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90162026-03-03T18:55:12.730ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90172026-03-03T18:55:12.732ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90182026-03-03T18:55:12.732ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90192026-03-03T18:55:12.732ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90202026-03-03T18:55:12.733ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90212026-03-03T18:55:12.733ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90222026-03-03T18:55:12.733ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90232026-03-03T18:55:12.733ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90242026-03-03T18:55:12.733ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90252026-03-03T18:55:12.735ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90262026-03-03T18:55:12.735ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90272026-03-03T18:55:12.735ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90282026-03-03T18:55:12.735ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90292026-03-03T18:55:12.737ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90302026-03-03T18:55:12.737ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90312026-03-03T18:55:12.737ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90322026-03-03T18:55:12.737ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90332026-03-03T18:55:12.738ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90342026-03-03T18:55:12.743ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90352026-03-03T18:55:12.743ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90362026-03-03T18:55:12.743ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90372026-03-03T18:55:12.743ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90382026-03-03T18:55:12.743ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90392026-03-03T18:55:12.743ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90402026-03-03T18:55:12.746ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90412026-03-03T18:55:12.746ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90422026-03-03T18:55:12.746ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90432026-03-03T18:55:12.746ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90442026-03-03T18:55:12.750ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90452026-03-03T18:55:12.751ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90462026-03-03T18:55:12.753ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
90472026-03-03T18:55:12.756ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (10855055105004541248) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.678314875' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
90482026-03-03T18:55:12.759ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 80204 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 02655f61-a400-44f3-9962-fb22ab8a0a37 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.678314875Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90492026-03-03T18:55:12.761ZINFOtest_instance_metrics (external client test context): client received response status = 200
90502026-03-03T18:55:12.762ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90512026-03-03T18:55:12.763ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90522026-03-03T18:55:12.763ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90532026-03-03T18:55:12.763ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90542026-03-03T18:55:12.763ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90552026-03-03T18:55:12.763ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90562026-03-03T18:55:12.763ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90572026-03-03T18:55:12.763ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90582026-03-03T18:55:12.763ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
90592026-03-03T18:55:12.763ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 2dd0b4af-5f01-4065-8f3e-6612a646c0a8 uri = /913233fe-92a8-4635-9572-183f495429c4
90602026-03-03T18:55:12.764ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90612026-03-03T18:55:12.764ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
90622026-03-03T18:55:12.764ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90632026-03-03T18:55:12.764ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90642026-03-03T18:55:12.764ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90652026-03-03T18:55:12.773ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 8338 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 2dd0b4af-5f01-4065-8f3e-6612a646c0a8 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
90662026-03-03T18:55:12.773ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90672026-03-03T18:55:12.779ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90682026-03-03T18:55:12.779ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90692026-03-03T18:55:12.779ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
90702026-03-03T18:55:12.779ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90712026-03-03T18:55:12.779ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90722026-03-03T18:55:12.779ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90732026-03-03T18:55:12.779ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
90742026-03-03T18:55:12.779ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
90752026-03-03T18:55:12.780ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
90762026-03-03T18:55:12.785ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
90772026-03-03T18:55:12.786ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90782026-03-03T18:55:12.786ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90792026-03-03T18:55:12.787ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90802026-03-03T18:55:12.788ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
90812026-03-03T18:55:12.788ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
90822026-03-03T18:55:12.788ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
90832026-03-03T18:55:12.788ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
90842026-03-03T18:55:12.788ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90852026-03-03T18:55:12.788ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90862026-03-03T18:55:12.789ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90872026-03-03T18:55:12.790ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
90882026-03-03T18:55:12.790ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
90892026-03-03T18:55:12.790ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
90902026-03-03T18:55:12.790ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90912026-03-03T18:55:12.790ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90922026-03-03T18:55:12.791ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
90932026-03-03T18:55:12.792ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
90942026-03-03T18:55:12.792ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
90952026-03-03T18:55:12.792ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
90962026-03-03T18:55:12.794ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
90972026-03-03T18:55:12.794ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
90982026-03-03T18:55:12.794ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
90992026-03-03T18:55:12.794ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
91002026-03-03T18:55:12.796ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
91012026-03-03T18:55:12.796ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
91022026-03-03T18:55:12.796ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
91032026-03-03T18:55:12.796ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
91042026-03-03T18:55:12.796ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
91052026-03-03T18:55:12.797ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
91062026-03-03T18:55:12.797ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91072026-03-03T18:55:12.797ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91082026-03-03T18:55:12.797ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
91092026-03-03T18:55:12.797ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
91102026-03-03T18:55:12.798ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
91112026-03-03T18:55:12.798ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
91122026-03-03T18:55:12.798ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
91132026-03-03T18:55:12.799ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
91142026-03-03T18:55:12.800ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
91152026-03-03T18:55:12.800ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
91162026-03-03T18:55:12.800ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
91172026-03-03T18:55:12.802ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
91182026-03-03T18:55:12.802ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91192026-03-03T18:55:12.802ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91202026-03-03T18:55:12.802ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91212026-03-03T18:55:12.802ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91222026-03-03T18:55:12.802ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91232026-03-03T18:55:12.803ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91242026-03-03T18:55:12.803ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
91252026-03-03T18:55:12.803ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91262026-03-03T18:55:12.804ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
91272026-03-03T18:55:12.804ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91282026-03-03T18:55:12.804ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91292026-03-03T18:55:12.804ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91302026-03-03T18:55:12.804ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91312026-03-03T18:55:12.805ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91322026-03-03T18:55:12.806ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91332026-03-03T18:55:12.808ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91342026-03-03T18:55:12.808ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91352026-03-03T18:55:12.808ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91362026-03-03T18:55:12.808ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91372026-03-03T18:55:12.809ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91382026-03-03T18:55:12.809ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91392026-03-03T18:55:12.810ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91402026-03-03T18:55:12.811ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91412026-03-03T18:55:12.811ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91422026-03-03T18:55:12.811ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91432026-03-03T18:55:12.811ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91442026-03-03T18:55:12.811ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91452026-03-03T18:55:12.812ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91462026-03-03T18:55:12.813ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91472026-03-03T18:55:12.813ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91482026-03-03T18:55:12.813ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91492026-03-03T18:55:12.814ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91502026-03-03T18:55:12.814ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91512026-03-03T18:55:12.814ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91522026-03-03T18:55:12.815ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91532026-03-03T18:55:12.816ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91542026-03-03T18:55:12.820ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91552026-03-03T18:55:12.820ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91562026-03-03T18:55:12.821ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91572026-03-03T18:55:12.821ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91582026-03-03T18:55:12.821ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91592026-03-03T18:55:12.821ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91602026-03-03T18:55:12.822ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91612026-03-03T18:55:12.823ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91622026-03-03T18:55:12.823ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91632026-03-03T18:55:12.823ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91642026-03-03T18:55:12.824ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91652026-03-03T18:55:12.827ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91662026-03-03T18:55:12.828ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
91672026-03-03T18:55:12.831ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (15918897146657644681) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.761985599' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
91682026-03-03T18:55:12.833ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 70574 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = f7417625-6a26-4feb-be38-4ab12679826e response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.761985599Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91692026-03-03T18:55:12.833ZINFOtest_instance_metrics (external client test context): client received response status = 200
91702026-03-03T18:55:12.833ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91712026-03-03T18:55:12.833ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91722026-03-03T18:55:12.833ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91732026-03-03T18:55:12.834ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91742026-03-03T18:55:12.834ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91752026-03-03T18:55:12.834ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91762026-03-03T18:55:12.834ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91772026-03-03T18:55:12.834ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91782026-03-03T18:55:12.834ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
91792026-03-03T18:55:12.834ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = c846c862-fbb7-424c-aa1b-fe9c4bf2f37c uri = /913233fe-92a8-4635-9572-183f495429c4
91802026-03-03T18:55:12.834ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91812026-03-03T18:55:12.834ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
91822026-03-03T18:55:12.834ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
91832026-03-03T18:55:12.834ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
91842026-03-03T18:55:12.835ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
91852026-03-03T18:55:12.841ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7433 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = c846c862-fbb7-424c-aa1b-fe9c4bf2f37c response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
91862026-03-03T18:55:12.842ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91872026-03-03T18:55:12.849ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91882026-03-03T18:55:12.850ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91892026-03-03T18:55:12.850ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
91902026-03-03T18:55:12.850ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91912026-03-03T18:55:12.850ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91922026-03-03T18:55:12.850ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91932026-03-03T18:55:12.850ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
91942026-03-03T18:55:12.850ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
91952026-03-03T18:55:12.850ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
91962026-03-03T18:55:12.856ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
91972026-03-03T18:55:12.857ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
91982026-03-03T18:55:12.857ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
91992026-03-03T18:55:12.858ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
92002026-03-03T18:55:12.859ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
92012026-03-03T18:55:12.859ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
92022026-03-03T18:55:12.860ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
92032026-03-03T18:55:12.860ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
92042026-03-03T18:55:12.860ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
92052026-03-03T18:55:12.860ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
92062026-03-03T18:55:12.861ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
92072026-03-03T18:55:12.861ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
92082026-03-03T18:55:12.861ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
92092026-03-03T18:55:12.861ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92102026-03-03T18:55:12.861ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
92112026-03-03T18:55:12.861ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
92122026-03-03T18:55:12.862ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
92132026-03-03T18:55:12.862ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
92142026-03-03T18:55:12.862ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
92152026-03-03T18:55:12.863ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
92162026-03-03T18:55:12.865ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
92172026-03-03T18:55:12.865ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
92182026-03-03T18:55:12.865ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
92192026-03-03T18:55:12.866ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
92202026-03-03T18:55:12.866ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
92212026-03-03T18:55:12.866ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
92222026-03-03T18:55:12.866ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
92232026-03-03T18:55:12.866ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
92242026-03-03T18:55:12.867ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
92252026-03-03T18:55:12.867ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
92262026-03-03T18:55:12.867ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
92272026-03-03T18:55:12.867ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
92282026-03-03T18:55:12.867ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
92292026-03-03T18:55:12.868ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
92302026-03-03T18:55:12.869ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
92312026-03-03T18:55:12.869ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
92322026-03-03T18:55:12.869ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
92332026-03-03T18:55:12.869ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
92342026-03-03T18:55:12.870ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
92352026-03-03T18:55:12.870ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
92362026-03-03T18:55:12.870ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
92372026-03-03T18:55:12.872ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
92382026-03-03T18:55:12.872ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92392026-03-03T18:55:12.872ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92402026-03-03T18:55:12.872ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92412026-03-03T18:55:12.872ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92422026-03-03T18:55:12.872ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92432026-03-03T18:55:12.873ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92442026-03-03T18:55:12.873ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
92452026-03-03T18:55:12.873ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
92462026-03-03T18:55:12.874ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92472026-03-03T18:55:12.874ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92482026-03-03T18:55:12.874ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92492026-03-03T18:55:12.875ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92502026-03-03T18:55:12.876ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92512026-03-03T18:55:12.878ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92522026-03-03T18:55:12.878ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92532026-03-03T18:55:12.878ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92542026-03-03T18:55:12.878ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92552026-03-03T18:55:12.879ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92562026-03-03T18:55:12.879ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92572026-03-03T18:55:12.879ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92582026-03-03T18:55:12.884ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92592026-03-03T18:55:12.884ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92602026-03-03T18:55:12.884ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92612026-03-03T18:55:12.884ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92622026-03-03T18:55:12.884ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92632026-03-03T18:55:12.886ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92642026-03-03T18:55:12.886ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92652026-03-03T18:55:12.886ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92662026-03-03T18:55:12.886ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92672026-03-03T18:55:12.888ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92682026-03-03T18:55:12.888ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92692026-03-03T18:55:12.888ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92702026-03-03T18:55:12.888ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92712026-03-03T18:55:12.890ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92722026-03-03T18:55:12.894ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92732026-03-03T18:55:12.894ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92742026-03-03T18:55:12.894ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92752026-03-03T18:55:12.894ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92762026-03-03T18:55:12.894ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92772026-03-03T18:55:12.895ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92782026-03-03T18:55:12.896ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92792026-03-03T18:55:12.896ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92802026-03-03T18:55:12.896ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92812026-03-03T18:55:12.897ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92822026-03-03T18:55:12.898ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92832026-03-03T18:55:12.900ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92842026-03-03T18:55:12.901ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
92852026-03-03T18:55:12.904ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (9666909797316088926) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.833773514' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
92862026-03-03T18:55:12.905ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
92872026-03-03T18:55:12.905ZDEBGtest_instance_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
92882026-03-03T18:55:12.906ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 72198 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = ffde67ec-f6f5-404c-86a3-c383c187a62e response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.833773514Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
92892026-03-03T18:55:12.906ZINFOtest_instance_metrics (external client test context): client received response status = 200
92902026-03-03T18:55:12.907ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
92912026-03-03T18:55:12.907ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
92922026-03-03T18:55:12.907ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
92932026-03-03T18:55:12.907ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
92942026-03-03T18:55:12.907ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
92952026-03-03T18:55:12.907ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
92962026-03-03T18:55:12.907ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
92972026-03-03T18:55:12.907ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
92982026-03-03T18:55:12.907ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1 version = 2026021900.0.0
92992026-03-03T18:55:12.907ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 5d6f54b1-d612-4eee-9ed8-4092075dde18 uri = /913233fe-92a8-4635-9572-183f495429c4
93002026-03-03T18:55:12.907ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93012026-03-03T18:55:12.907ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93022026-03-03T18:55:12.907ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93032026-03-03T18:55:12.908ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93042026-03-03T18:55:12.908ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93052026-03-03T18:55:12.914ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7275 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 5d6f54b1-d612-4eee-9ed8-4092075dde18 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
93062026-03-03T18:55:12.915ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93072026-03-03T18:55:12.927ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93082026-03-03T18:55:12.927ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93092026-03-03T18:55:12.927ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93102026-03-03T18:55:12.927ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
93112026-03-03T18:55:12.928ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
93122026-03-03T18:55:12.928ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
93132026-03-03T18:55:12.928ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
93142026-03-03T18:55:12.928ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
93152026-03-03T18:55:12.928ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
93162026-03-03T18:55:12.934ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
93172026-03-03T18:55:12.935ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93182026-03-03T18:55:12.935ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93192026-03-03T18:55:12.935ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93202026-03-03T18:55:12.936ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
93212026-03-03T18:55:12.936ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
93222026-03-03T18:55:12.937ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
93232026-03-03T18:55:12.937ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
93242026-03-03T18:55:12.937ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93252026-03-03T18:55:12.937ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93262026-03-03T18:55:12.937ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93272026-03-03T18:55:12.938ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
93282026-03-03T18:55:12.938ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
93292026-03-03T18:55:12.939ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
93302026-03-03T18:55:12.939ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93312026-03-03T18:55:12.939ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93322026-03-03T18:55:12.939ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93332026-03-03T18:55:12.940ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
93342026-03-03T18:55:12.940ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
93352026-03-03T18:55:12.940ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
93362026-03-03T18:55:12.942ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
93372026-03-03T18:55:12.942ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93382026-03-03T18:55:12.942ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93392026-03-03T18:55:12.943ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93402026-03-03T18:55:12.944ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
93412026-03-03T18:55:12.944ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
93422026-03-03T18:55:12.944ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93432026-03-03T18:55:12.944ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93442026-03-03T18:55:12.944ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93452026-03-03T18:55:12.945ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
93462026-03-03T18:55:12.945ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
93472026-03-03T18:55:12.945ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
93482026-03-03T18:55:12.945ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
93492026-03-03T18:55:12.945ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
93502026-03-03T18:55:12.946ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
93512026-03-03T18:55:12.946ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93522026-03-03T18:55:12.946ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93532026-03-03T18:55:12.946ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93542026-03-03T18:55:12.947ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
93552026-03-03T18:55:12.947ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
93562026-03-03T18:55:12.948ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
93572026-03-03T18:55:12.950ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
93582026-03-03T18:55:12.950ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93592026-03-03T18:55:12.950ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93602026-03-03T18:55:12.950ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93612026-03-03T18:55:12.950ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93622026-03-03T18:55:12.950ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93632026-03-03T18:55:12.950ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93642026-03-03T18:55:12.951ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
93652026-03-03T18:55:12.951ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
93662026-03-03T18:55:12.952ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93672026-03-03T18:55:12.954ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93682026-03-03T18:55:12.955ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93692026-03-03T18:55:12.955ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93702026-03-03T18:55:12.955ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93712026-03-03T18:55:12.955ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93722026-03-03T18:55:12.955ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93732026-03-03T18:55:12.957ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93742026-03-03T18:55:12.959ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93752026-03-03T18:55:12.961ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
93762026-03-03T18:55:12.964ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.906990451' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
93772026-03-03T18:55:12.966ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 58481 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = bad2237b-a502-4d34-b2c9-a15ce5b38f82 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.906990451Z&order=descending&limit=1
93782026-03-03T18:55:12.966ZINFOtest_instance_metrics (external client test context): client received response status = 200
93792026-03-03T18:55:12.966ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
93802026-03-03T18:55:12.966ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93812026-03-03T18:55:12.966ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93822026-03-03T18:55:12.966ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93832026-03-03T18:55:12.966ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
93842026-03-03T18:55:12.966ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1 version = 2026021900.0.0
93852026-03-03T18:55:12.967ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 37cbd60c-bb0b-4763-849e-6b985587125c uri = /913233fe-92a8-4635-9572-183f495429c4
93862026-03-03T18:55:12.967ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
93872026-03-03T18:55:12.967ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
93882026-03-03T18:55:12.967ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
93892026-03-03T18:55:12.967ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
93902026-03-03T18:55:12.967ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
93912026-03-03T18:55:12.973ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6812 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 37cbd60c-bb0b-4763-849e-6b985587125c response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
93922026-03-03T18:55:12.974ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93932026-03-03T18:55:12.981ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93942026-03-03T18:55:12.981ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93952026-03-03T18:55:12.981ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
93962026-03-03T18:55:12.981ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
93972026-03-03T18:55:12.982ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
93982026-03-03T18:55:12.988ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
93992026-03-03T18:55:12.988ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94002026-03-03T18:55:12.989ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94012026-03-03T18:55:12.989ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94022026-03-03T18:55:12.990ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
94032026-03-03T18:55:12.990ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
94042026-03-03T18:55:12.991ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
94052026-03-03T18:55:12.991ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
94062026-03-03T18:55:12.991ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94072026-03-03T18:55:12.991ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94082026-03-03T18:55:12.991ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94092026-03-03T18:55:12.992ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
94102026-03-03T18:55:12.992ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
94112026-03-03T18:55:12.993ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94122026-03-03T18:55:12.993ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94132026-03-03T18:55:12.993ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94142026-03-03T18:55:12.993ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94152026-03-03T18:55:12.994ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
94162026-03-03T18:55:12.994ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
94172026-03-03T18:55:12.994ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
94182026-03-03T18:55:12.996ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
94192026-03-03T18:55:12.996ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94202026-03-03T18:55:12.996ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94212026-03-03T18:55:12.997ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94222026-03-03T18:55:13.003ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
94232026-03-03T18:55:13.003ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
94242026-03-03T18:55:13.003ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
94252026-03-03T18:55:13.003ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
94262026-03-03T18:55:13.003ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94272026-03-03T18:55:13.003ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94282026-03-03T18:55:13.004ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94292026-03-03T18:55:13.005ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94302026-03-03T18:55:13.005ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94312026-03-03T18:55:13.005ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94322026-03-03T18:55:13.006ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94332026-03-03T18:55:13.006ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
94342026-03-03T18:55:13.006ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
94352026-03-03T18:55:13.006ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94362026-03-03T18:55:13.006ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94372026-03-03T18:55:13.006ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94382026-03-03T18:55:13.008ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
94392026-03-03T18:55:13.009ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
94402026-03-03T18:55:13.010ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94412026-03-03T18:55:13.010ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94422026-03-03T18:55:13.010ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94432026-03-03T18:55:13.010ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94442026-03-03T18:55:13.010ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94452026-03-03T18:55:13.010ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94462026-03-03T18:55:13.010ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94472026-03-03T18:55:13.011ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94482026-03-03T18:55:13.011ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94492026-03-03T18:55:13.011ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
94502026-03-03T18:55:13.011ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
94512026-03-03T18:55:13.011ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
94522026-03-03T18:55:13.012ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
94532026-03-03T18:55:13.013ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94542026-03-03T18:55:13.015ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94552026-03-03T18:55:13.015ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94562026-03-03T18:55:13.016ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94572026-03-03T18:55:13.016ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94582026-03-03T18:55:13.016ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94592026-03-03T18:55:13.016ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94602026-03-03T18:55:13.016ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
94612026-03-03T18:55:13.016ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
94622026-03-03T18:55:13.018ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
94632026-03-03T18:55:13.018ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
94642026-03-03T18:55:13.018ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94652026-03-03T18:55:13.020ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94662026-03-03T18:55:13.022ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
94672026-03-03T18:55:13.024ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (7763646387282271213) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:12.966522066' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
94682026-03-03T18:55:13.026ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 59604 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 177a9b2a-a10f-4219-ae8a-a97eed1d290f response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:12.966522066Z&order=descending&limit=1
94692026-03-03T18:55:13.026ZINFOtest_instance_metrics (external client test context): client received response status = 200
94702026-03-03T18:55:13.027ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
94712026-03-03T18:55:13.027ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
94722026-03-03T18:55:13.027ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1 version = 2026021900.0.0
94732026-03-03T18:55:13.027ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
94742026-03-03T18:55:13.027ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
94752026-03-03T18:55:13.027ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94762026-03-03T18:55:13.027ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94772026-03-03T18:55:13.028ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94782026-03-03T18:55:13.029ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94792026-03-03T18:55:13.029ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94802026-03-03T18:55:13.030ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94812026-03-03T18:55:13.031ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
94822026-03-03T18:55:13.031ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
94832026-03-03T18:55:13.031ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94842026-03-03T18:55:13.031ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94852026-03-03T18:55:13.031ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94862026-03-03T18:55:13.032ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
94872026-03-03T18:55:13.032ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94882026-03-03T18:55:13.032ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94892026-03-03T18:55:13.033ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94902026-03-03T18:55:13.034ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
94912026-03-03T18:55:13.036ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
94922026-03-03T18:55:13.036ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94932026-03-03T18:55:13.036ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94942026-03-03T18:55:13.036ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
94952026-03-03T18:55:13.037ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
94962026-03-03T18:55:13.037ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
94972026-03-03T18:55:13.037ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
94982026-03-03T18:55:13.037ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
94992026-03-03T18:55:13.038ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95002026-03-03T18:55:13.038ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95012026-03-03T18:55:13.038ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95022026-03-03T18:55:13.039ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95032026-03-03T18:55:13.039ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95042026-03-03T18:55:13.040ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
95052026-03-03T18:55:13.042ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
95062026-03-03T18:55:13.042ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95072026-03-03T18:55:13.042ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95082026-03-03T18:55:13.042ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95092026-03-03T18:55:13.042ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95102026-03-03T18:55:13.042ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95112026-03-03T18:55:13.042ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95122026-03-03T18:55:13.044ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95132026-03-03T18:55:13.046ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95142026-03-03T18:55:13.046ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95152026-03-03T18:55:13.046ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95162026-03-03T18:55:13.046ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95172026-03-03T18:55:13.046ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95182026-03-03T18:55:13.047ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95192026-03-03T18:55:13.054ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95202026-03-03T18:55:13.057ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95212026-03-03T18:55:13.059ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
95222026-03-03T18:55:13.062ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10733361587332781639) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.026974243' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
95232026-03-03T18:55:13.064ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 36821 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 728559b3-5ef1-4a47-b1a9-af5f0ba69776 response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.026974243Z&order=descending&limit=1
95242026-03-03T18:55:13.064ZINFOtest_instance_metrics (external client test context): client received response status = 200
95252026-03-03T18:55:13.064ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95262026-03-03T18:55:13.064ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95272026-03-03T18:55:13.064ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
95282026-03-03T18:55:13.064ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95292026-03-03T18:55:13.064ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95302026-03-03T18:55:13.064ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95312026-03-03T18:55:13.064ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95322026-03-03T18:55:13.065ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95332026-03-03T18:55:13.066ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95342026-03-03T18:55:13.066ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95352026-03-03T18:55:13.067ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95362026-03-03T18:55:13.068ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
95372026-03-03T18:55:13.068ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
95382026-03-03T18:55:13.068ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95392026-03-03T18:55:13.068ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95402026-03-03T18:55:13.069ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95412026-03-03T18:55:13.070ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95422026-03-03T18:55:13.070ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95432026-03-03T18:55:13.070ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95442026-03-03T18:55:13.070ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95452026-03-03T18:55:13.071ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
95462026-03-03T18:55:13.073ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
95472026-03-03T18:55:13.073ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95482026-03-03T18:55:13.073ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95492026-03-03T18:55:13.073ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95502026-03-03T18:55:13.074ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
95512026-03-03T18:55:13.074ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
95522026-03-03T18:55:13.074ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95532026-03-03T18:55:13.075ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95542026-03-03T18:55:13.075ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95552026-03-03T18:55:13.076ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
95562026-03-03T18:55:13.076ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
95572026-03-03T18:55:13.076ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
95582026-03-03T18:55:13.076ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
95592026-03-03T18:55:13.077ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
95602026-03-03T18:55:13.079ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
95612026-03-03T18:55:13.079ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95622026-03-03T18:55:13.079ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95632026-03-03T18:55:13.079ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95642026-03-03T18:55:13.079ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95652026-03-03T18:55:13.079ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95662026-03-03T18:55:13.079ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95672026-03-03T18:55:13.081ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95682026-03-03T18:55:13.083ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95692026-03-03T18:55:13.083ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95702026-03-03T18:55:13.083ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95712026-03-03T18:55:13.084ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95722026-03-03T18:55:13.085ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95732026-03-03T18:55:13.085ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95742026-03-03T18:55:13.085ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95752026-03-03T18:55:13.085ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95762026-03-03T18:55:13.085ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95772026-03-03T18:55:13.087ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95782026-03-03T18:55:13.087ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95792026-03-03T18:55:13.087ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95802026-03-03T18:55:13.087ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95812026-03-03T18:55:13.088ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95822026-03-03T18:55:13.090ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95832026-03-03T18:55:13.090ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95842026-03-03T18:55:13.090ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95852026-03-03T18:55:13.090ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95862026-03-03T18:55:13.090ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95872026-03-03T18:55:13.090ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95882026-03-03T18:55:13.092ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95892026-03-03T18:55:13.094ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95902026-03-03T18:55:13.096ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
95912026-03-03T18:55:13.099ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.064389943' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
95922026-03-03T18:55:13.100ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 36202 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 904b5dbe-cfcc-494e-a777-2dd58b79844d response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.064389943Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95932026-03-03T18:55:13.101ZINFOtest_instance_metrics (external client test context): client received response status = 200
95942026-03-03T18:55:13.101ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95952026-03-03T18:55:13.101ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95962026-03-03T18:55:13.101ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
95972026-03-03T18:55:13.101ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95982026-03-03T18:55:13.101ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
95992026-03-03T18:55:13.101ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96002026-03-03T18:55:13.101ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96012026-03-03T18:55:13.102ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96022026-03-03T18:55:13.103ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96032026-03-03T18:55:13.103ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96042026-03-03T18:55:13.104ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96052026-03-03T18:55:13.105ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
96062026-03-03T18:55:13.105ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
96072026-03-03T18:55:13.105ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96082026-03-03T18:55:13.105ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96092026-03-03T18:55:13.105ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96102026-03-03T18:55:13.106ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96112026-03-03T18:55:13.106ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96122026-03-03T18:55:13.106ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96132026-03-03T18:55:13.107ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96142026-03-03T18:55:13.107ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
96152026-03-03T18:55:13.107ZDEBGtest_instance_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
96162026-03-03T18:55:13.107ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96172026-03-03T18:55:13.107ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96182026-03-03T18:55:13.107ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96192026-03-03T18:55:13.107ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96202026-03-03T18:55:13.107ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96212026-03-03T18:55:13.107ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96222026-03-03T18:55:13.107ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96232026-03-03T18:55:13.108ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 1c735dc2-fe73-4298-af57-9cac40d131a9 uri = /913233fe-92a8-4635-9572-183f495429c4
96242026-03-03T18:55:13.113ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5565 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 1c735dc2-fe73-4298-af57-9cac40d131a9 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
96252026-03-03T18:55:13.113ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
96262026-03-03T18:55:13.116ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
96272026-03-03T18:55:13.116ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96282026-03-03T18:55:13.116ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96292026-03-03T18:55:13.116ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96302026-03-03T18:55:13.117ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96312026-03-03T18:55:13.124ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96322026-03-03T18:55:13.124ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96332026-03-03T18:55:13.124ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
96342026-03-03T18:55:13.124ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
96352026-03-03T18:55:13.124ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
96362026-03-03T18:55:13.130ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
96372026-03-03T18:55:13.131ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
96382026-03-03T18:55:13.131ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
96392026-03-03T18:55:13.131ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96402026-03-03T18:55:13.131ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96412026-03-03T18:55:13.132ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96422026-03-03T18:55:13.132ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
96432026-03-03T18:55:13.132ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
96442026-03-03T18:55:13.133ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
96452026-03-03T18:55:13.133ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96462026-03-03T18:55:13.133ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96472026-03-03T18:55:13.134ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96482026-03-03T18:55:13.134ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
96492026-03-03T18:55:13.134ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
96502026-03-03T18:55:13.135ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
96512026-03-03T18:55:13.137ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
96522026-03-03T18:55:13.137ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96532026-03-03T18:55:13.137ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96542026-03-03T18:55:13.137ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96552026-03-03T18:55:13.137ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96562026-03-03T18:55:13.137ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96572026-03-03T18:55:13.137ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96582026-03-03T18:55:13.138ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
96592026-03-03T18:55:13.138ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
96602026-03-03T18:55:13.139ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96612026-03-03T18:55:13.142ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96622026-03-03T18:55:13.142ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96632026-03-03T18:55:13.142ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96642026-03-03T18:55:13.142ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96652026-03-03T18:55:13.143ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
96662026-03-03T18:55:13.143ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
96672026-03-03T18:55:13.143ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96682026-03-03T18:55:13.143ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96692026-03-03T18:55:13.143ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96702026-03-03T18:55:13.143ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96712026-03-03T18:55:13.144ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96722026-03-03T18:55:13.145ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96732026-03-03T18:55:13.145ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96742026-03-03T18:55:13.145ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96752026-03-03T18:55:13.146ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96762026-03-03T18:55:13.147ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96772026-03-03T18:55:13.149ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96782026-03-03T18:55:13.149ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96792026-03-03T18:55:13.149ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96802026-03-03T18:55:13.149ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96812026-03-03T18:55:13.149ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96822026-03-03T18:55:13.149ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96832026-03-03T18:55:13.151ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96842026-03-03T18:55:13.153ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96852026-03-03T18:55:13.155ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
96862026-03-03T18:55:13.158ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.101278872' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
96872026-03-03T18:55:13.159ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 58320 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 9c822366-6ed7-4fd6-842a-0536c9ce8efb response_code = 200 uri = /v1/system/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.101278872Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96882026-03-03T18:55:13.160ZINFOtest_instance_metrics (external client test context): client received response status = 200
96892026-03-03T18:55:13.160ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96902026-03-03T18:55:13.160ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96912026-03-03T18:55:13.160ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000 version = 2026021900.0.0
96922026-03-03T18:55:13.160ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96932026-03-03T18:55:13.160ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
96942026-03-03T18:55:13.160ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96952026-03-03T18:55:13.160ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96962026-03-03T18:55:13.161ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
96972026-03-03T18:55:13.162ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
96982026-03-03T18:55:13.162ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
96992026-03-03T18:55:13.163ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97002026-03-03T18:55:13.164ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
97012026-03-03T18:55:13.164ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
97022026-03-03T18:55:13.164ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97032026-03-03T18:55:13.164ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97042026-03-03T18:55:13.164ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97052026-03-03T18:55:13.165ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97062026-03-03T18:55:13.165ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97072026-03-03T18:55:13.165ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97082026-03-03T18:55:13.166ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97092026-03-03T18:55:13.167ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
97102026-03-03T18:55:13.169ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
97112026-03-03T18:55:13.169ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97122026-03-03T18:55:13.169ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97132026-03-03T18:55:13.169ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97142026-03-03T18:55:13.170ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
97152026-03-03T18:55:13.170ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
97162026-03-03T18:55:13.170ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97172026-03-03T18:55:13.170ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97182026-03-03T18:55:13.170ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97192026-03-03T18:55:13.171ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97202026-03-03T18:55:13.171ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97212026-03-03T18:55:13.171ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97222026-03-03T18:55:13.172ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97232026-03-03T18:55:13.173ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
97242026-03-03T18:55:13.174ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
97252026-03-03T18:55:13.175ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97262026-03-03T18:55:13.175ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97272026-03-03T18:55:13.175ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97282026-03-03T18:55:13.175ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97292026-03-03T18:55:13.175ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97302026-03-03T18:55:13.175ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97312026-03-03T18:55:13.177ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97322026-03-03T18:55:13.179ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97332026-03-03T18:55:13.179ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97342026-03-03T18:55:13.179ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97352026-03-03T18:55:13.179ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97362026-03-03T18:55:13.181ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97372026-03-03T18:55:13.181ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97382026-03-03T18:55:13.181ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97392026-03-03T18:55:13.181ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97402026-03-03T18:55:13.181ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97412026-03-03T18:55:13.182ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97422026-03-03T18:55:13.182ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97432026-03-03T18:55:13.183ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97442026-03-03T18:55:13.183ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97452026-03-03T18:55:13.184ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97462026-03-03T18:55:13.186ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97472026-03-03T18:55:13.186ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97482026-03-03T18:55:13.186ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97492026-03-03T18:55:13.186ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97502026-03-03T18:55:13.186ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97512026-03-03T18:55:13.186ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97522026-03-03T18:55:13.187ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97532026-03-03T18:55:13.197ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97542026-03-03T18:55:13.197ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
97552026-03-03T18:55:13.201ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.160242306' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
97562026-03-03T18:55:13.208ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 40457 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 3d17d4dc-4f81-4fd9-9acc-6b4ca203855c response_code = 200 uri = /v1/system/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.160242306Z&order=descending&limit=1&silo=001de000-5110-4000-8000-000000000000
97572026-03-03T18:55:13.208ZINFOtest_instance_metrics (external client test context): client received response status = 200
97582026-03-03T18:55:13.208ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = DELETE uri = http://127.0.0.1:36591/v1/instances/just-rainsticks?project=springfield-squidport
97592026-03-03T18:55:13.208ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a uri = /v1/instances/just-rainsticks?project=springfield-squidport
97602026-03-03T18:55:13.208ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a uri = /v1/instances/just-rainsticks?project=springfield-squidport version = 2026021900.0.0
97612026-03-03T18:55:13.208ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a uri = /v1/instances/just-rainsticks?project=springfield-squidport
97622026-03-03T18:55:13.208ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/instances/just-rainsticks?project=springfield-squidport
97632026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97642026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97652026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97662026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97672026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97682026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97692026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
97702026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
97712026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97722026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97732026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97742026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
97752026-03-03T18:55:13.208ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97762026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97772026-03-03T18:55:13.208ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97782026-03-03T18:55:13.208ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
97792026-03-03T18:55:13.208ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
97802026-03-03T18:55:13.208ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97812026-03-03T18:55:13.208ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97822026-03-03T18:55:13.208ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97832026-03-03T18:55:13.208ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97842026-03-03T18:55:13.208ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97852026-03-03T18:55:13.208ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97862026-03-03T18:55:13.208ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97872026-03-03T18:55:13.208ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97882026-03-03T18:55:13.208ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97892026-03-03T18:55:13.209ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
97902026-03-03T18:55:13.211ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
97912026-03-03T18:55:13.211ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
97922026-03-03T18:55:13.211ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
97932026-03-03T18:55:13.212ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
97942026-03-03T18:55:13.213ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97952026-03-03T18:55:13.213ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97962026-03-03T18:55:13.213ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97972026-03-03T18:55:13.213ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
97982026-03-03T18:55:13.213ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
97992026-03-03T18:55:13.213ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
98002026-03-03T18:55:13.213ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
98012026-03-03T18:55:13.214ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
98022026-03-03T18:55:13.214ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
98032026-03-03T18:55:13.214ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98042026-03-03T18:55:13.214ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98052026-03-03T18:55:13.214ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98062026-03-03T18:55:13.216ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
98072026-03-03T18:55:13.216ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
98082026-03-03T18:55:13.217ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
98092026-03-03T18:55:13.217ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
98102026-03-03T18:55:13.217ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98112026-03-03T18:55:13.217ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
98122026-03-03T18:55:13.217ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
98132026-03-03T18:55:13.218ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
98142026-03-03T18:55:13.219ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
98152026-03-03T18:55:13.221ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
98162026-03-03T18:55:13.221ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a uri = /v1/instances/just-rainsticks?project=springfield-squidport
98172026-03-03T18:55:13.221ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98182026-03-03T18:55:13.221ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98192026-03-03T18:55:13.221ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98202026-03-03T18:55:13.222ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98212026-03-03T18:55:13.222ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98222026-03-03T18:55:13.223ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98232026-03-03T18:55:13.225ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98242026-03-03T18:55:13.225ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98252026-03-03T18:55:13.225ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98262026-03-03T18:55:13.225ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98272026-03-03T18:55:13.227ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98282026-03-03T18:55:13.227ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98292026-03-03T18:55:13.227ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98302026-03-03T18:55:13.229ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98312026-03-03T18:55:13.229ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98322026-03-03T18:55:13.229ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98332026-03-03T18:55:13.230ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98342026-03-03T18:55:13.230ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98352026-03-03T18:55:13.230ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98362026-03-03T18:55:13.232ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Delete actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98372026-03-03T18:55:13.232ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98382026-03-03T18:55:13.232ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98392026-03-03T18:55:13.232ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98402026-03-03T18:55:13.232ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98412026-03-03T18:55:13.234ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98422026-03-03T18:55:13.234ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98432026-03-03T18:55:13.234ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98442026-03-03T18:55:13.234ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98452026-03-03T18:55:13.236ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98462026-03-03T18:55:13.236ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98472026-03-03T18:55:13.236ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98482026-03-03T18:55:13.236ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98492026-03-03T18:55:13.238ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98502026-03-03T18:55:13.242ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98512026-03-03T18:55:13.242ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98522026-03-03T18:55:13.242ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98532026-03-03T18:55:13.242ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98542026-03-03T18:55:13.242ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98552026-03-03T18:55:13.242ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98562026-03-03T18:55:13.244ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98572026-03-03T18:55:13.244ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98582026-03-03T18:55:13.244ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98592026-03-03T18:55:13.244ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98602026-03-03T18:55:13.245ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98612026-03-03T18:55:13.245ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98622026-03-03T18:55:13.246ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98632026-03-03T18:55:13.246ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98642026-03-03T18:55:13.247ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98652026-03-03T18:55:13.251ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98662026-03-03T18:55:13.254ZINFOtest_instance_metrics (dropshot_external): set intended instance state authenticated = true changed = true instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 intended_state = destroyed local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
98672026-03-03T18:55:13.254ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
98682026-03-03T18:55:13.254ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
98692026-03-03T18:55:13.254ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
98702026-03-03T18:55:13.254ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
98712026-03-03T18:55:13.254ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
98722026-03-03T18:55:13.255ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
98732026-03-03T18:55:13.257ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
98742026-03-03T18:55:13.257ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
98752026-03-03T18:55:13.257ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
98762026-03-03T18:55:13.257ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
98772026-03-03T18:55:13.259ZINFOtest_instance_metrics (SagaQuiesceHandle): tracking newly created saga saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
98782026-03-03T18:55:13.259ZINFOtest_instance_metrics (SagaExecutor): preparing saga saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete
98792026-03-03T18:55:13.259ZINFOtest_instance_metrics (SEC): saga create dag = {"end_node":7,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[6,0,null],[5,7,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_dendrite_config","label":"InstanceDeleteDendriteConfig","name":"no_result6"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Action":{"action_name":"instance_delete.detach_external_subnets","label":"DetachExternalSubnets","name":"no_result4"}},{"Action":{"action_name":"instance_delete.leave_multicast_groups","label":"LeaveMulticastGroups","name":"no_result5"}},{"Start":{"params":{"authz_instance":{"key":"62af126f-88fe-4275-b8a4-75b87584f9b2","lookup_type":{"ByName":"just-rainsticks"},"parent":{"key":"f04dd7b1-f806-4002-8222-cf99123d65c7","lookup_type":{"ByName":"springfield-squidport"},"parent":{"key":"001de000-5110-4000-8000-000000000000","lookup_type":{"ById":"001de000-5110-4000-8000-000000000000"},"parent":null}}},"boundary_switches":[],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":null,"cpu_platform":null,"hostname":"the-host","identity":{"description":"instance \\"just-rainsticks\\"","id":"62af126f-88fe-4275-b8a4-75b87584f9b2","name":"just-rainsticks","time_created":"2026-03-03T18:55:09.423319Z","time_deleted":null,"time_modified":"2026-03-03T18:55:11.070939Z"},"intended_state":"Stopped","memory":1073741824,"ncpus":4,"project_id":"f04dd7b1-f806-4002-8222-cf99123d65c7","runtime_state":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2026-03-03T18:55:11.443650Z"},"updater_gen":4,"updater_id":null,"user_data":[35,99,108,111,117,100,45,99,111,110,102,105,103,10,115,121,115,116,101,109,95,105,110,102,111,58,10,32,32,100,101,102,97,117,108,116,95,117,115,101,114,58,10,32,32,32,32,110,97,109,101,58,32,111,120,105,100,101]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"001de000-5110-4000-8000-000000000000","silo_user_id":"001de000-05e4-4000-8000-000000004007"}},"credential_id":null,"device_token_expiration":null},{"mapped_fleet_roles":{}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":6} saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete sec_id = 913233fe-92a8-4635-9572-183f495429c4
98802026-03-03T18:55:13.259ZINFOtest_instance_metrics (SecStore): creating saga saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete
98812026-03-03T18:55:13.261ZINFOtest_instance_metrics (SagaExecutor): starting saga saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete
98822026-03-03T18:55:13.261ZINFOtest_instance_metrics (SEC): saga start saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete sec_id = 913233fe-92a8-4635-9572-183f495429c4
98832026-03-03T18:55:13.261ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
98842026-03-03T18:55:13.261ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
98852026-03-03T18:55:13.262ZDEBGtest_instance_metrics (SEC): saga log event new_state = N006 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
98862026-03-03T18:55:13.262ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
98872026-03-03T18:55:13.263ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
98882026-03-03T18:55:13.263ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
98892026-03-03T18:55:13.265ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98902026-03-03T18:55:13.265ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98912026-03-03T18:55:13.265ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98922026-03-03T18:55:13.266ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98932026-03-03T18:55:13.267ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98942026-03-03T18:55:13.267ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98952026-03-03T18:55:13.268ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98962026-03-03T18:55:13.268ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98972026-03-03T18:55:13.268ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98982026-03-03T18:55:13.275ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
98992026-03-03T18:55:13.275ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99002026-03-03T18:55:13.275ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99012026-03-03T18:55:13.275ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99022026-03-03T18:55:13.275ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99032026-03-03T18:55:13.277ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99042026-03-03T18:55:13.277ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99052026-03-03T18:55:13.277ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99062026-03-03T18:55:13.277ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99072026-03-03T18:55:13.279ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99082026-03-03T18:55:13.279ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99092026-03-03T18:55:13.279ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99102026-03-03T18:55:13.279ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99112026-03-03T18:55:13.281ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99122026-03-03T18:55:13.285ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ById(62af126f-88fe-4275-b8a4-75b87584f9b2) } result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99132026-03-03T18:55:13.285ZINFOtest_instance_metrics (nexus): deleting instance dpd configuration instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2
99142026-03-03T18:55:13.285ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99152026-03-03T18:55:13.285ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99162026-03-03T18:55:13.286ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99172026-03-03T18:55:13.287ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99182026-03-03T18:55:13.287ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99192026-03-03T18:55:13.287ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99202026-03-03T18:55:13.288ZWARNtest_instance_metrics (nexus): no matching nat entries to soft delete
99212026-03-03T18:55:13.289ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99222026-03-03T18:55:13.289ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99232026-03-03T18:55:13.289ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteDendriteConfig silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99242026-03-03T18:55:13.300ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet
99252026-03-03T18:55:13.301ZTRACtest_instance_metrics (InstanceAllocator): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
99262026-03-03T18:55:13.301ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
99272026-03-03T18:55:13.301ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
99282026-03-03T18:55:13.301ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
99292026-03-03T18:55:13.304ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
99302026-03-03T18:55:13.306ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Fleet result = Ok(())
99312026-03-03T18:55:13.307ZTRACtest_instance_metrics (InstanceAllocator): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database
99322026-03-03T18:55:13.307ZDEBGtest_instance_metrics (InstanceAllocator): roles roles = RoleSet { roles: {} }
99332026-03-03T18:55:13.307ZDEBGtest_instance_metrics (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead (built_in_user), .. }) resource = Database result = Ok(())
99342026-03-03T18:55:13.307ZTRACtest_instance_metrics (results-sink): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99352026-03-03T18:55:13.309ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
99362026-03-03T18:55:13.309ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
99372026-03-03T18:55:13.309ZTRACtest_instance_metrics (results-sink-cluster): batch interval expired, but no samples to insert collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99382026-03-03T18:55:13.309ZDEBGtest_instance_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99392026-03-03T18:55:13.309ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99402026-03-03T18:55:13.309ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99412026-03-03T18:55:13.309ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99422026-03-03T18:55:13.310ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 6be9f45c-4ab4-4be1-b2b3-1ab94d6231fb uri = /913233fe-92a8-4635-9572-183f495429c4
99432026-03-03T18:55:13.310ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 30 46 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 0F..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:5044 req_id = f9afb54c-2af3-4c5f-b72a-bb42f91309f5
99442026-03-03T18:55:13.310ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 12358,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:5044 req_id = f9afb54c-2af3-4c5f-b72a-bb42f91309f5
99452026-03-03T18:55:13.310ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
99462026-03-03T18:55:13.310ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
99472026-03-03T18:55:13.310ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:5044 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = f9afb54c-2af3-4c5f-b72a-bb42f91309f5
99482026-03-03T18:55:13.316ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6240 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 6be9f45c-4ab4-4be1-b2b3-1ab94d6231fb response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
99492026-03-03T18:55:13.316ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1850, tv_nsec: 581386315 } })
99502026-03-03T18:55:13.316ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
99512026-03-03T18:55:13.317ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99522026-03-03T18:55:13.324ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99532026-03-03T18:55:13.325ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99542026-03-03T18:55:13.325ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
99552026-03-03T18:55:13.325ZDEBGtest_instance_metrics (results-sink): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99562026-03-03T18:55:13.326ZDEBGtest_instance_metrics (clickhouse-client): unrolling 16 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
99572026-03-03T18:55:13.331ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 32 sql = INSERT INTO oximeter.fields_string FORMAT Native
99582026-03-03T18:55:13.331ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: b2 f7 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e ............-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:22294 req_id = 444a2c32-7794-47bf-8516-e63cdd7df918
99592026-03-03T18:55:13.331ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 45815,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:22294 req_id = 444a2c32-7794-47bf-8516-e63cdd7df918
99602026-03-03T18:55:13.331ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
99612026-03-03T18:55:13.331ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:22294 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 444a2c32-7794-47bf-8516-e63cdd7df918
99622026-03-03T18:55:13.350ZTRACtest_instance_metrics (DpdClient): client request body = None method = GET uri = http://[::1]:39131/switch/identifiers
99632026-03-03T18:55:13.351ZTRACtest_instance_metrics (DpdClient): client response result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3d1194d-3977-4bbf-9879-64c5f6909fc0", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:13 GMT"} })
99642026-03-03T18:55:13.352ZDEBGtest_instance_metrics (SEC): saga log event new_state = N000 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
99652026-03-03T18:55:13.353ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
99662026-03-03T18:55:13.355ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 32 table_name = fields_string
99672026-03-03T18:55:13.355ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
99682026-03-03T18:55:13.355ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
99692026-03-03T18:55:13.355ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
99702026-03-03T18:55:13.357ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_u16
99712026-03-03T18:55:13.358ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 16 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
99722026-03-03T18:55:13.358ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Delete actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99732026-03-03T18:55:13.358ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99742026-03-03T18:55:13.358ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99752026-03-03T18:55:13.358ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99762026-03-03T18:55:13.358ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99772026-03-03T18:55:13.361ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = fields_uuid
99782026-03-03T18:55:13.361ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 16 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
99792026-03-03T18:55:13.361ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99802026-03-03T18:55:13.361ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99812026-03-03T18:55:13.361ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99822026-03-03T18:55:13.361ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99832026-03-03T18:55:13.363ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 16 table_name = measurements_histogramu64
99842026-03-03T18:55:13.363ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
99852026-03-03T18:55:13.363ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99862026-03-03T18:55:13.363ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99872026-03-03T18:55:13.363ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99882026-03-03T18:55:13.364ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99892026-03-03T18:55:13.365ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99902026-03-03T18:55:13.370ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99912026-03-03T18:55:13.370ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99922026-03-03T18:55:13.370ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99932026-03-03T18:55:13.370ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99942026-03-03T18:55:13.377ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99952026-03-03T18:55:13.378ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99962026-03-03T18:55:13.378ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99972026-03-03T18:55:13.379ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99982026-03-03T18:55:13.380ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
99992026-03-03T18:55:13.380ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100002026-03-03T18:55:13.381ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100012026-03-03T18:55:13.381ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100022026-03-03T18:55:13.381ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100032026-03-03T18:55:13.382ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100042026-03-03T18:55:13.382ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100052026-03-03T18:55:13.383ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = InstanceDeleteRecord silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100062026-03-03T18:55:13.384ZDEBGtest_instance_metrics (SEC): saga log event new_state = N001 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
100072026-03-03T18:55:13.386ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100082026-03-03T18:55:13.386ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
100092026-03-03T18:55:13.386ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100102026-03-03T18:55:13.387ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100112026-03-03T18:55:13.388ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100122026-03-03T18:55:13.388ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100132026-03-03T18:55:13.388ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100142026-03-03T18:55:13.388ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100152026-03-03T18:55:13.389ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100162026-03-03T18:55:13.389ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100172026-03-03T18:55:13.389ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100182026-03-03T18:55:13.390ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100192026-03-03T18:55:13.391ZTRACtest_instance_metrics (SagaExecutor): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100202026-03-03T18:55:13.391ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100212026-03-03T18:55:13.391ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100222026-03-03T18:55:13.392ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100232026-03-03T18:55:13.393ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100242026-03-03T18:55:13.398ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ByName("springfield-squidport") }, key: 62af126f-88fe-4275-b8a4-75b87584f9b2, lookup_type: ByName("just-rainsticks") } result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100252026-03-03T18:55:13.398ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100262026-03-03T18:55:13.398ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100272026-03-03T18:55:13.398ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeleteNetworkInterfaces silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100282026-03-03T18:55:13.406ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Signaled
100292026-03-03T18:55:13.406ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
100302026-03-03T18:55:13.407ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100312026-03-03T18:55:13.407ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
100322026-03-03T18:55:13.408ZDEBGtest_instance_metrics (SEC): saga log event new_state = N002 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
100332026-03-03T18:55:13.408ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100342026-03-03T18:55:13.410ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
100352026-03-03T18:55:13.410ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
100362026-03-03T18:55:13.410ZDEBGtest_instance_metrics (collection-task): sent timer-based collection request to the collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
100372026-03-03T18:55:13.410ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
100382026-03-03T18:55:13.411ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
100392026-03-03T18:55:13.411ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100402026-03-03T18:55:13.412ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
100412026-03-03T18:55:13.413ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
100422026-03-03T18:55:13.413ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
100432026-03-03T18:55:13.413ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
100442026-03-03T18:55:13.415ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100452026-03-03T18:55:13.415ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100462026-03-03T18:55:13.416ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100472026-03-03T18:55:13.416ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
100482026-03-03T18:55:13.416ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100492026-03-03T18:55:13.417ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
100502026-03-03T18:55:13.421ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
100512026-03-03T18:55:13.421ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100522026-03-03T18:55:13.421ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
100532026-03-03T18:55:13.421ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100542026-03-03T18:55:13.422ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
100552026-03-03T18:55:13.423ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100562026-03-03T18:55:13.430ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100572026-03-03T18:55:13.430ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet
100582026-03-03T18:55:13.430ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = v2p_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
100592026-03-03T18:55:13.430ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
100602026-03-03T18:55:13.430ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100612026-03-03T18:55:13.430ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
100622026-03-03T18:55:13.431ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100632026-03-03T18:55:13.434ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100642026-03-03T18:55:13.434ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database
100652026-03-03T18:55:13.434ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100662026-03-03T18:55:13.434ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = v2p_manager resource = Database result = Ok(())
100672026-03-03T18:55:13.445ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager body = None method = GET uri = http://[::1]:37139/v2p
100682026-03-03T18:55:13.445ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44680 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
100692026-03-03T18:55:13.446ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44680 req_id = 53052fdf-0816-4f83-980e-4728a92ff700 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
100702026-03-03T18:55:13.446ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44680 req_id = 53052fdf-0816-4f83-980e-4728a92ff700 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p version = 23.0.0
100712026-03-03T18:55:13.446ZINFOtest_instance_metrics (dropshot): request completed latency_us = 171 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44680 req_id = 53052fdf-0816-4f83-980e-4728a92ff700 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /v2p
100722026-03-03T18:55:13.446ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = v2p_manager result = Ok(Response { url: "http://[::1]:37139/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53052fdf-0816-4f83-980e-4728a92ff700", "content-length": "2", "date": "Tue, 03 Mar 2026 18:55:13 GMT"} })
100732026-03-03T18:55:13.446ZINFOtest_instance_metrics (BackgroundTasks): found opte v2p mappings background_task = v2p_manager interfaces = {} sled = SimGimlet00
100742026-03-03T18:55:13.446ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to delete background_task = v2p_manager mappings = [] sled = SimGimlet00
100752026-03-03T18:55:13.446ZINFOtest_instance_metrics (BackgroundTasks): v2p mappings to add background_task = v2p_manager mappings = [] sled = SimGimlet00
100762026-03-03T18:55:13.446ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 39.800914ms iteration = 4 status = {}
100772026-03-03T18:55:13.476ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100782026-03-03T18:55:13.476ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100792026-03-03T18:55:13.476ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DeallocateExternalIp silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100802026-03-03T18:55:13.508ZDEBGtest_instance_metrics (SEC): saga log event new_state = N003 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
100812026-03-03T18:55:13.508ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100822026-03-03T18:55:13.511ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
100832026-03-03T18:55:13.511ZDEBGtest_instance_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
100842026-03-03T18:55:13.512ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
100852026-03-03T18:55:13.512ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100862026-03-03T18:55:13.515ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DetachExternalSubnets silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100872026-03-03T18:55:13.515ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DetachExternalSubnets silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100882026-03-03T18:55:13.516ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = DetachExternalSubnets silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100892026-03-03T18:55:13.518ZDEBGtest_instance_metrics (SEC): saga log event new_state = N004 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
100902026-03-03T18:55:13.518ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100912026-03-03T18:55:13.519ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
100922026-03-03T18:55:13.519ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100932026-03-03T18:55:13.521ZTRACtest_instance_metrics (SagaExecutor): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = LeaveMulticastGroups silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100942026-03-03T18:55:13.521ZDEBGtest_instance_metrics (SagaExecutor): roles authenticated = true roles = RoleSet { roles: {} } saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = LeaveMulticastGroups silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100952026-03-03T18:55:13.522ZDEBGtest_instance_metrics (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true resource = Database result = Ok(()) saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_node = LeaveMulticastGroups silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user
100962026-03-03T18:55:13.524ZINFOtest_instance_metrics (SagaExecutor): Marked multicast members for removal instance_id = 62af126f-88fe-4275-b8a4-75b87584f9b2 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete
100972026-03-03T18:55:13.524ZDEBGtest_instance_metrics (SEC): saga log event new_state = N005 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
100982026-03-03T18:55:13.524ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
100992026-03-03T18:55:13.527ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 started sec_id = 913233fe-92a8-4635-9572-183f495429c4
101002026-03-03T18:55:13.527ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
101012026-03-03T18:55:13.528ZDEBGtest_instance_metrics (SEC): saga log event new_state = N007 succeeded sec_id = 913233fe-92a8-4635-9572-183f495429c4
101022026-03-03T18:55:13.528ZDEBGtest_instance_metrics (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
101032026-03-03T18:55:13.530ZINFOtest_instance_metrics (SEC): update for saga cached state new_state = Done saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 sec_id = 913233fe-92a8-4635-9572-183f495429c4
101042026-03-03T18:55:13.530ZINFOtest_instance_metrics (SecStore): updating state new_state = done saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
101052026-03-03T18:55:13.532ZINFOtest_instance_metrics (SEC): saga finished result = success saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete sec_id = 913233fe-92a8-4635-9572-183f495429c4
101062026-03-03T18:55:13.532ZINFOtest_instance_metrics (SagaQuiesceHandle): tracked saga has finished saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052
101072026-03-03T18:55:13.532ZINFOtest_instance_metrics (SagaExecutor): saga finished saga_id = 2571c3e1-fb3c-49bc-baee-97e18a128052 saga_name = instance-delete saga_result = SagaResult { saga_id: 2571c3e1-fb3c-49bc-baee-97e18a128052, saga_log: SagaLog { saga_id: 2571c3e1-fb3c-49bc-baee-97e18a128052, unwinding: false, events: [N006 started, N006 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N007 started, N007 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null, "no_result5": Null, "no_result6": Null} }) }
101082026-03-03T18:55:13.532ZTRACtest_instance_metrics (dropshot_external): authorize begin action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = AuditLog silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101092026-03-03T18:55:13.532ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101102026-03-03T18:55:13.532ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101112026-03-03T18:55:13.532ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101122026-03-03T18:55:13.533ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101132026-03-03T18:55:13.533ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Signaled
101142026-03-03T18:55:13.533ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager running background_task = vpc_route_manager
101152026-03-03T18:55:13.533ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
101162026-03-03T18:55:13.533ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101172026-03-03T18:55:13.533ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101182026-03-03T18:55:13.533ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101192026-03-03T18:55:13.534ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101202026-03-03T18:55:13.534ZDEBGtest_instance_metrics (BackgroundTasks): activating background_task = multicast_reconciler iteration = 8 reason = Signaled
101212026-03-03T18:55:13.534ZTRACtest_instance_metrics (BackgroundTasks): multicast group reconciler activating background_task = multicast_reconciler
101222026-03-03T18:55:13.534ZTRACtest_instance_metrics (BackgroundTasks): starting multicast reconciliation pass background_task = multicast_reconciler
101232026-03-03T18:55:13.534ZTRACtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal
101242026-03-03T18:55:13.535ZTRACtest_instance_metrics (dns): buffer buffer = Length: 72 (0x48) bytes\n0000: 9b 61 01 00 00 01 00 00 00 00 00 01 09 5f 64 65 .a..........._de\n0010: 6e 64 72 69 74 65 04 5f 74 63 70 0d 63 6f 6e 74 ndrite._tcp.cont\n0020: 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 69 64 65 08 rol-plane.oxide.\n0030: 69 6e 74 65 72 6e 61 6c 00 00 21 00 01 00 00 29 internal..!....)\n0040: 04 d0 00 00 00 00 00 00 ........ kind = dns peer_addr = [::1]:5195 req_id = a650ebed-dbbd-412b-9729-f5f9d6589e9e
101252026-03-03T18:55:13.535ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 39777,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("_dendrite._tcp.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("_dendrite._tcp.control-plane.oxide.internal."),\n query_type: SRV,\n query_class: IN,\n },\n },\n ],\n original: [\n 9,\n 95,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 4,\n 95,\n 116,\n 99,\n 112,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 33,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:5195 req_id = a650ebed-dbbd-412b-9729-f5f9d6589e9e
101262026-03-03T18:55:13.535ZDEBGtest_instance_metrics (store): query key key = _dendrite._tcp
101272026-03-03T18:55:13.535ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
101282026-03-03T18:55:13.535ZDEBGtest_instance_metrics (dns): dns response additional_records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal"), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] kind = dns peer_addr = [::1]:5195 query = LowerQuery { name: LowerName(Name("_dendrite._tcp.control-plane.oxide.internal.")), original: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } } records = [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal") }) }] req_id = a650ebed-dbbd-412b-9729-f5f9d6589e9e
101292026-03-03T18:55:13.535ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101302026-03-03T18:55:13.538ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101312026-03-03T18:55:13.538ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet
101322026-03-03T18:55:13.538ZTRACtest_instance_metrics (BackgroundTasks): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. } background_task = vpc_route_manager resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
101332026-03-03T18:55:13.538ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101342026-03-03T18:55:13.538ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101352026-03-03T18:55:13.538ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101362026-03-03T18:55:13.539ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101372026-03-03T18:55:13.540ZDEBGtest_instance_metrics (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = AuditLog result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101382026-03-03T18:55:13.540ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101392026-03-03T18:55:13.540ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101402026-03-03T18:55:13.541ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/instances/just-rainsticks?project=springfield-squidport
101412026-03-03T18:55:13.542ZDEBGtest_instance_metrics (DnsResolver): lookup_all_socket_v6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 39131, target: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }], valid_until: Instant { tv_sec: 1850, tv_nsec: 806905726 } })
101422026-03-03T18:55:13.542ZTRACtest_instance_metrics (DnsResolver): lookup_service_targets: looking up SRV target
101432026-03-03T18:55:13.542ZTRACtest_instance_metrics (dns): buffer buffer = Length: 108 (0x6c) bytes\n0000: a4 78 01 00 00 01 00 00 00 00 00 01 2d 64 65 6e .x..........-den\n0010: 64 72 69 74 65 2d 62 36 64 36 35 33 34 31 2d 31 drite-b6d65341-1\n0020: 36 37 63 2d 34 31 64 66 2d 39 62 35 63 2d 34 31 67c-41df-9b5c-41\n0030: 63 64 65 64 39 39 63 32 32 39 04 68 6f 73 74 0d cded99c229.host.\n0040: 63 6f 6e 74 72 6f 6c 2d 70 6c 61 6e 65 05 6f 78 control-plane.ox\n0050: 69 64 65 08 69 6e 74 65 72 6e 61 6c 00 00 1c 00 ide.internal....\n0060: 01 00 00 29 04 d0 00 00 00 00 00 00 ...)........ kind = dns peer_addr = [::1]:41200 req_id = 683c36f4-222a-4354-b478-9ef0df08bf5c
101442026-03-03T18:55:13.542ZDEBGtest_instance_metrics (dns): message_request kind = dns mr = MessageRequest {\n header: Header {\n id: 42104,\n message_type: Query,\n op_code: Query,\n authoritative: false,\n truncation: false,\n recursion_desired: true,\n recursion_available: false,\n authentic_data: false,\n checking_disabled: false,\n response_code: NoError,\n query_count: 1,\n answer_count: 0,\n name_server_count: 0,\n additional_count: 1,\n },\n queries: Queries {\n queries: [\n LowerQuery {\n name: LowerName(\n Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n ),\n original: Query {\n name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."),\n query_type: AAAA,\n query_class: IN,\n },\n },\n ],\n original: [\n 45,\n 100,\n 101,\n 110,\n 100,\n 114,\n 105,\n 116,\n 101,\n 45,\n 98,\n 54,\n 100,\n 54,\n 53,\n 51,\n 52,\n 49,\n 45,\n 49,\n 54,\n 55,\n 99,\n 45,\n 52,\n 49,\n 100,\n 102,\n 45,\n 57,\n 98,\n 53,\n 99,\n 45,\n 52,\n 49,\n 99,\n 100,\n 101,\n 100,\n 57,\n 57,\n 99,\n 50,\n 50,\n 57,\n 4,\n 104,\n 111,\n 115,\n 116,\n 13,\n 99,\n 111,\n 110,\n 116,\n 114,\n 111,\n 108,\n 45,\n 112,\n 108,\n 97,\n 110,\n 101,\n 5,\n 111,\n 120,\n 105,\n 100,\n 101,\n 8,\n 105,\n 110,\n 116,\n 101,\n 114,\n 110,\n 97,\n 108,\n 0,\n 0,\n 28,\n 0,\n 1,\n ],\n },\n answers: [],\n name_servers: [],\n additionals: [],\n sig0: [],\n edns: Some(\n Edns {\n rcode_high: 0,\n version: 0,\n flags: EdnsFlags {\n dnssec_ok: false,\n z: 0,\n },\n max_payload: 1232,\n options: OPT {\n options: [],\n },\n },\n ),\n} peer_addr = [::1]:41200 req_id = 683c36f4-222a-4354-b478-9ef0df08bf5c
101452026-03-03T18:55:13.542ZDEBGtest_instance_metrics (store): query key key = dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host
101462026-03-03T18:55:13.545ZDEBGtest_instance_metrics (dns): dns response additional_records = [] kind = dns peer_addr = [::1]:41200 query = LowerQuery { name: LowerName(Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal.")), original: Query { name: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), query_type: AAAA, query_class: IN } } records = [Record { name_labels: Name("dendrite-b6d65341-167c-41df-9b5c-41cded99c229.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(::1)) }] req_id = 683c36f4-222a-4354-b478-9ef0df08bf5c
101472026-03-03T18:55:13.545ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101482026-03-03T18:55:13.549ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101492026-03-03T18:55:13.549ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101502026-03-03T18:55:13.549ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101512026-03-03T18:55:13.549ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101522026-03-03T18:55:13.569ZTRACtest_instance_metrics (DpdClient): client request background_task = multicast_reconciler body = None method = GET uri = http://[::1]:39131/switch/identifiers
101532026-03-03T18:55:13.569ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 368157 local_addr = 127.0.0.1:36591 method = DELETE remote_addr = 127.0.0.1:46210 req_id = 346d5455-91c0-4559-ba2f-b49108a9a54a response_code = 204 uri = /v1/instances/just-rainsticks?project=springfield-squidport
101542026-03-03T18:55:13.570ZINFOtest_instance_metrics (external client test context): client received response status = 204
101552026-03-03T18:55:13.570ZTRACtest_instance_metrics: authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database
101562026-03-03T18:55:13.570ZDEBGtest_instance_metrics: roles roles = RoleSet { roles: {} }
101572026-03-03T18:55:13.570ZDEBGtest_instance_metrics: authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) resource = Database result = Ok(())
101582026-03-03T18:55:13.579ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager
101592026-03-03T18:55:13.579ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = None method = GET uri = http://[::1]:37139/vpc-routes
101602026-03-03T18:55:13.580ZINFOtest_instance_metrics (dropshot): accepted connection local_addr = [::1]:37139 remote_addr = [::1]:44682 sled_id = b6d65341-167c-41df-9b5c-41cded99c229
101612026-03-03T18:55:13.580ZTRACtest_instance_metrics (DpdClient): client response background_task = multicast_reconciler result = Ok(Response { url: "http://[::1]:39131/switch/identifiers", status: 200, headers: {"content-type": "application/json", "x-request-id": "96da36e4-a13f-44c5-9013-27f3f1fcb9af", "content-length": "206", "date": "Tue, 03 Mar 2026 18:55:13 GMT"} })
101622026-03-03T18:55:13.580ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Creating
101632026-03-03T18:55:13.580ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
101642026-03-03T18:55:13.580ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
101652026-03-03T18:55:13.580ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
101662026-03-03T18:55:13.581ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = GET remote_addr = [::1]:44682 req_id = fe00ab63-fd8a-4984-9a5a-541d2202fa30 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
101672026-03-03T18:55:13.581ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = GET remote_addr = [::1]:44682 req_id = fe00ab63-fd8a-4984-9a5a-541d2202fa30 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
101682026-03-03T18:55:13.581ZINFOtest_instance_metrics (dropshot): request completed latency_us = 198 local_addr = [::1]:37139 method = GET remote_addr = [::1]:44682 req_id = fe00ab63-fd8a-4984-9a5a-541d2202fa30 response_code = 200 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
101692026-03-03T18:55:13.583ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
101702026-03-03T18:55:13.583ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101712026-03-03T18:55:13.583ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101722026-03-03T18:55:13.583ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe00ab63-fd8a-4984-9a5a-541d2202fa30", "content-length": "214", "date": "Tue, 03 Mar 2026 18:55:13 GMT"} })
101732026-03-03T18:55:13.583ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
101742026-03-03T18:55:13.583ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101752026-03-03T18:55:13.583ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101762026-03-03T18:55:13.583ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101772026-03-03T18:55:13.583ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Creating
101782026-03-03T18:55:13.583ZTRACtest_instance_metrics (BackgroundTasks): reconciling member state changes background_task = multicast_reconciler
101792026-03-03T18:55:13.583ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
101802026-03-03T18:55:13.583ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
101812026-03-03T18:55:13.583ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
101822026-03-03T18:55:13.584ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
101832026-03-03T18:55:13.584ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1 version = 2026021900.0.0
101842026-03-03T18:55:13.584ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 8e4bc475-d93a-4fcc-b2c2-a26e56bb9573 uri = /913233fe-92a8-4635-9572-183f495429c4
101852026-03-03T18:55:13.584ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
101862026-03-03T18:55:13.584ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
101872026-03-03T18:55:13.584ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
101882026-03-03T18:55:13.584ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
101892026-03-03T18:55:13.585ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
101902026-03-03T18:55:13.591ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7076 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = 8e4bc475-d93a-4fcc-b2c2-a26e56bb9573 response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
101912026-03-03T18:55:13.592ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101922026-03-03T18:55:13.600ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101932026-03-03T18:55:13.600ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101942026-03-03T18:55:13.600ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
101952026-03-03T18:55:13.600ZDEBGtest_instance_metrics (results-sink): inserting 18 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
101962026-03-03T18:55:13.600ZDEBGtest_instance_metrics (clickhouse-client): unrolling 18 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
101972026-03-03T18:55:13.606ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 36 sql = INSERT INTO oximeter.fields_string FORMAT Native
101982026-03-03T18:55:13.606ZDEBGtest_instance_metrics (BackgroundTasks): member state reconciliation completed background_task = multicast_reconciler members_processed = 0
101992026-03-03T18:55:13.606ZTRACtest_instance_metrics (BackgroundTasks): cleaning up deleted multicast members background_task = multicast_reconciler
102002026-03-03T18:55:13.606ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102012026-03-03T18:55:13.606ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102022026-03-03T18:55:13.607ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102032026-03-03T18:55:13.607ZINFOtest_instance_metrics (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager sled = SimGimlet00
102042026-03-03T18:55:13.607ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/eip-gateways
102052026-03-03T18:55:13.608ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102062026-03-03T18:55:13.608ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102072026-03-03T18:55:13.608ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102082026-03-03T18:55:13.609ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44682 req_id = 9e161398-8a3e-410f-bd9e-b7de3f334244 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
102092026-03-03T18:55:13.609ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44682 req_id = 9e161398-8a3e-410f-bd9e-b7de3f334244 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways version = 23.0.0
102102026-03-03T18:55:13.609ZINFOtest_instance_metrics (dropshot): request completed latency_us = 235 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44682 req_id = 9e161398-8a3e-410f-bd9e-b7de3f334244 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /eip-gateways
102112026-03-03T18:55:13.609ZDEBGtest_instance_metrics (BackgroundTasks): multicast group member complete deletion finished background_task = multicast_reconciler left_and_time_deleted_members_deleted = 0
102122026-03-03T18:55:13.609ZTRACtest_instance_metrics (BackgroundTasks): checking for empty multicast groups to implicitly delete background_task = multicast_reconciler
102132026-03-03T18:55:13.609ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102142026-03-03T18:55:13.609ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102152026-03-03T18:55:13.610ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102162026-03-03T18:55:13.610ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
102172026-03-03T18:55:13.610ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102182026-03-03T18:55:13.610ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102192026-03-03T18:55:13.610ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102202026-03-03T18:55:13.611ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102212026-03-03T18:55:13.611ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 36 table_name = fields_string
102222026-03-03T18:55:13.611ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 17 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
102232026-03-03T18:55:13.611ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/eip-gateways", status: 204, headers: {"x-request-id": "9e161398-8a3e-410f-bd9e-b7de3f334244", "date": "Tue, 03 Mar 2026 18:55:13 GMT"} })
102242026-03-03T18:55:13.611ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102252026-03-03T18:55:13.611ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102262026-03-03T18:55:13.612ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102272026-03-03T18:55:13.612ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
102282026-03-03T18:55:13.612ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102292026-03-03T18:55:13.612ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102302026-03-03T18:55:13.612ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102312026-03-03T18:55:13.612ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102322026-03-03T18:55:13.613ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102332026-03-03T18:55:13.613ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102342026-03-03T18:55:13.613ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102352026-03-03T18:55:13.613ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102362026-03-03T18:55:13.613ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Active
102372026-03-03T18:55:13.613ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102382026-03-03T18:55:13.613ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102392026-03-03T18:55:13.614ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102402026-03-03T18:55:13.614ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102412026-03-03T18:55:13.614ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102422026-03-03T18:55:13.614ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102432026-03-03T18:55:13.615ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 17 table_name = fields_u16
102442026-03-03T18:55:13.615ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 17 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
102452026-03-03T18:55:13.616ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
102462026-03-03T18:55:13.618ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
102472026-03-03T18:55:13.618ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102482026-03-03T18:55:13.618ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102492026-03-03T18:55:13.618ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102502026-03-03T18:55:13.619ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Active
102512026-03-03T18:55:13.619ZTRACtest_instance_metrics (BackgroundTasks): searching for multicast groups background_task = multicast_reconciler state = Deleting
102522026-03-03T18:55:13.619ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database
102532026-03-03T18:55:13.619ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = multicast_reconciler roles = RoleSet { roles: {} }
102542026-03-03T18:55:13.619ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = multicast_reconciler resource = Database result = Ok(())
102552026-03-03T18:55:13.619ZTRACtest_instance_metrics (BackgroundTasks): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database
102562026-03-03T18:55:13.620ZDEBGtest_instance_metrics (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102572026-03-03T18:55:13.620ZDEBGtest_instance_metrics (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002 (built_in_user), .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102582026-03-03T18:55:13.620ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102592026-03-03T18:55:13.621ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102602026-03-03T18:55:13.621ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102612026-03-03T18:55:13.621ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
102622026-03-03T18:55:13.621ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
102632026-03-03T18:55:13.621ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
102642026-03-03T18:55:13.621ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102652026-03-03T18:55:13.621ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102662026-03-03T18:55:13.622ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102672026-03-03T18:55:13.622ZTRACtest_instance_metrics (BackgroundTasks): found multicast groups background_task = multicast_reconciler count = 0 state = Deleting
102682026-03-03T18:55:13.622ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation cycle completed active_groups_verified = 0 background_task = multicast_reconciler error_count = 0 external_groups_created = 0 external_groups_deleted = 0 member_lifecycle_transitions = 0 orphaned_member_cleanup = 0 total_dpd_operations = 0
102692026-03-03T18:55:13.624ZTRACtest_instance_metrics (BackgroundTasks): multicast RPW reconciliation pass completed - dataplane consistent background_task = multicast_reconciler
102702026-03-03T18:55:13.624ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = multicast_reconciler elapsed = 89.704954ms iteration = 8 status = {"disabled":false,"empty_groups_marked":0,"errors":[],"groups_created":0,"groups_deleted":0,"groups_verified":0,"members_deleted":0,"members_processed":0}
102712026-03-03T18:55:13.624ZINFOtest_instance_metrics (BackgroundTasks): VPC route manager sled b6d65341-167c-41df-9b5c-41cded99c229 push not needed background_task = vpc_route_manager
102722026-03-03T18:55:13.624ZDEBGtest_instance_metrics (BackgroundTasks): client request SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[::1]:37139/vpc-routes
102732026-03-03T18:55:13.625ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
102742026-03-03T18:55:13.625ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
102752026-03-03T18:55:13.625ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
102762026-03-03T18:55:13.626ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
102772026-03-03T18:55:13.626ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 17 table_name = fields_uuid
102782026-03-03T18:55:13.626ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 17 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
102792026-03-03T18:55:13.626ZTRACtest_instance_metrics (dropshot): incoming request local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44682 req_id = 8e8e4d03-bb6c-48d8-81cd-1ca06a351921 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
102802026-03-03T18:55:13.626ZDEBGtest_instance_metrics (dropshot): determined request API version local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44682 req_id = 8e8e4d03-bb6c-48d8-81cd-1ca06a351921 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes version = 23.0.0
102812026-03-03T18:55:13.627ZINFOtest_instance_metrics (dropshot): request completed latency_us = 418 local_addr = [::1]:37139 method = PUT remote_addr = [::1]:44682 req_id = 8e8e4d03-bb6c-48d8-81cd-1ca06a351921 response_code = 204 sled_id = b6d65341-167c-41df-9b5c-41cded99c229 uri = /vpc-routes
102822026-03-03T18:55:13.627ZDEBGtest_instance_metrics (BackgroundTasks): client response SledAgent = b6d65341-167c-41df-9b5c-41cded99c229 background_task = vpc_route_manager result = Ok(Response { url: "http://[::1]:37139/vpc-routes", status: 204, headers: {"x-request-id": "8e8e4d03-bb6c-48d8-81cd-1ca06a351921", "date": "Tue, 03 Mar 2026 18:55:13 GMT"} })
102832026-03-03T18:55:13.628ZDEBGtest_instance_metrics (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 94.332461ms iteration = 5 status = {}
102842026-03-03T18:55:13.628ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 17 table_name = measurements_histogramu64
102852026-03-03T18:55:13.628ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
102862026-03-03T18:55:13.629ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
102872026-03-03T18:55:13.631ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
102882026-03-03T18:55:13.631ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
102892026-03-03T18:55:13.631ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
102902026-03-03T18:55:13.631ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
102912026-03-03T18:55:13.631ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
102922026-03-03T18:55:13.631ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
102932026-03-03T18:55:13.631ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
102942026-03-03T18:55:13.633ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
102952026-03-03T18:55:13.633ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102962026-03-03T18:55:13.633ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
102972026-03-03T18:55:13.633ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
102982026-03-03T18:55:13.633ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
102992026-03-03T18:55:13.634ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103002026-03-03T18:55:13.634ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103012026-03-03T18:55:13.634ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103022026-03-03T18:55:13.634ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103032026-03-03T18:55:13.636ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
103042026-03-03T18:55:13.636ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
103052026-03-03T18:55:13.636ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103062026-03-03T18:55:13.638ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103072026-03-03T18:55:13.638ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103082026-03-03T18:55:13.638ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103092026-03-03T18:55:13.638ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103102026-03-03T18:55:13.638ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103112026-03-03T18:55:13.638ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103122026-03-03T18:55:13.639ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
103132026-03-03T18:55:13.639ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
103142026-03-03T18:55:13.640ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103152026-03-03T18:55:13.640ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103162026-03-03T18:55:13.640ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103172026-03-03T18:55:13.640ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103182026-03-03T18:55:13.642ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103192026-03-03T18:55:13.643ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103202026-03-03T18:55:13.645ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
103212026-03-03T18:55:13.647ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (6332272717670687644) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.582051051' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
103222026-03-03T18:55:13.649ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 65499 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 361faa83-a8a5-449f-b66d-8e9ca0efcdf0 response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.582051051Z&order=descending&limit=1
103232026-03-03T18:55:13.650ZINFOtest_instance_metrics (external client test context): client received response status = 200
103242026-03-03T18:55:13.650ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103252026-03-03T18:55:13.650ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103262026-03-03T18:55:13.650ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1 version = 2026021900.0.0
103272026-03-03T18:55:13.650ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103282026-03-03T18:55:13.650ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103292026-03-03T18:55:13.650ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103302026-03-03T18:55:13.650ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103312026-03-03T18:55:13.651ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103322026-03-03T18:55:13.652ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103332026-03-03T18:55:13.652ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103342026-03-03T18:55:13.653ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103352026-03-03T18:55:13.654ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
103362026-03-03T18:55:13.654ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
103372026-03-03T18:55:13.654ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103382026-03-03T18:55:13.654ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103392026-03-03T18:55:13.654ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103402026-03-03T18:55:13.659ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103412026-03-03T18:55:13.659ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103422026-03-03T18:55:13.659ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103432026-03-03T18:55:13.659ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103442026-03-03T18:55:13.660ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
103452026-03-03T18:55:13.663ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
103462026-03-03T18:55:13.663ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103472026-03-03T18:55:13.663ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103482026-03-03T18:55:13.663ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103492026-03-03T18:55:13.668ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
103502026-03-03T18:55:13.668ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
103512026-03-03T18:55:13.668ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103522026-03-03T18:55:13.668ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103532026-03-03T18:55:13.669ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103542026-03-03T18:55:13.670ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
103552026-03-03T18:55:13.670ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103562026-03-03T18:55:13.670ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103572026-03-03T18:55:13.670ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103582026-03-03T18:55:13.671ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
103592026-03-03T18:55:13.673ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
103602026-03-03T18:55:13.673ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103612026-03-03T18:55:13.673ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103622026-03-03T18:55:13.673ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103632026-03-03T18:55:13.673ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103642026-03-03T18:55:13.673ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103652026-03-03T18:55:13.674ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103662026-03-03T18:55:13.675ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103672026-03-03T18:55:13.675ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103682026-03-03T18:55:13.675ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103692026-03-03T18:55:13.675ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103702026-03-03T18:55:13.677ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103712026-03-03T18:55:13.678ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103722026-03-03T18:55:13.678ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103732026-03-03T18:55:13.679ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103742026-03-03T18:55:13.679ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103752026-03-03T18:55:13.679ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103762026-03-03T18:55:13.679ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103772026-03-03T18:55:13.680ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103782026-03-03T18:55:13.680ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103792026-03-03T18:55:13.680ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103802026-03-03T18:55:13.680ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103812026-03-03T18:55:13.682ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103822026-03-03T18:55:13.683ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103832026-03-03T18:55:13.685ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
103842026-03-03T18:55:13.687ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (14090496300427388374) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.650292981' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
103852026-03-03T18:55:13.689ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 39193 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 26603b88-be55-4743-99ec-09f60b1a7aa3 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.650292981Z&order=descending&limit=1
103862026-03-03T18:55:13.689ZINFOtest_instance_metrics (external client test context): client received response status = 200
103872026-03-03T18:55:13.690ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
103882026-03-03T18:55:13.690ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
103892026-03-03T18:55:13.690ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1 version = 2026021900.0.0
103902026-03-03T18:55:13.690ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
103912026-03-03T18:55:13.690ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
103922026-03-03T18:55:13.690ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103932026-03-03T18:55:13.690ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103942026-03-03T18:55:13.691ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103952026-03-03T18:55:13.692ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
103962026-03-03T18:55:13.692ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
103972026-03-03T18:55:13.693ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
103982026-03-03T18:55:13.694ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
103992026-03-03T18:55:13.694ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104002026-03-03T18:55:13.694ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104012026-03-03T18:55:13.694ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104022026-03-03T18:55:13.694ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104032026-03-03T18:55:13.695ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104042026-03-03T18:55:13.698ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104052026-03-03T18:55:13.698ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104062026-03-03T18:55:13.698ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104072026-03-03T18:55:13.698ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
104082026-03-03T18:55:13.699ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
104092026-03-03T18:55:13.699ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104102026-03-03T18:55:13.699ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104112026-03-03T18:55:13.699ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104122026-03-03T18:55:13.700ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
104132026-03-03T18:55:13.700ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104142026-03-03T18:55:13.700ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104152026-03-03T18:55:13.700ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104162026-03-03T18:55:13.700ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104172026-03-03T18:55:13.701ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104182026-03-03T18:55:13.701ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104192026-03-03T18:55:13.701ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104202026-03-03T18:55:13.702ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104212026-03-03T18:55:13.703ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
104222026-03-03T18:55:13.704ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
104232026-03-03T18:55:13.704ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104242026-03-03T18:55:13.704ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104252026-03-03T18:55:13.705ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104262026-03-03T18:55:13.705ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104272026-03-03T18:55:13.705ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104282026-03-03T18:55:13.705ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104292026-03-03T18:55:13.706ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104302026-03-03T18:55:13.706ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104312026-03-03T18:55:13.706ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104322026-03-03T18:55:13.707ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104332026-03-03T18:55:13.708ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104342026-03-03T18:55:13.710ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104352026-03-03T18:55:13.710ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104362026-03-03T18:55:13.710ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104372026-03-03T18:55:13.710ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104382026-03-03T18:55:13.710ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104392026-03-03T18:55:13.710ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104402026-03-03T18:55:13.711ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104412026-03-03T18:55:13.711ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104422026-03-03T18:55:13.711ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104432026-03-03T18:55:13.712ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104442026-03-03T18:55:13.713ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
104452026-03-03T18:55:13.713ZDEBGtest_instance_metrics (results-sink-cluster): inserting 16 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104462026-03-03T18:55:13.713ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104472026-03-03T18:55:13.713ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104482026-03-03T18:55:13.713ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104492026-03-03T18:55:13.713ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104502026-03-03T18:55:13.713ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104512026-03-03T18:55:13.715ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104522026-03-03T18:55:13.717ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104532026-03-03T18:55:13.717ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = '001de000-5110-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
104542026-03-03T18:55:13.717ZTRACtest_instance_metrics (dropshot): incoming request local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = b6b4d52b-1554-44e3-9511-9461db0158ba uri = /913233fe-92a8-4635-9572-183f495429c4
104552026-03-03T18:55:13.723ZINFOtest_instance_metrics (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 5741 local_addr = 127.0.0.1:37169 method = GET remote_addr = 127.0.0.1:56348 req_id = b6b4d52b-1554-44e3-9511-9461db0158ba response_code = 200 uri = /913233fe-92a8-4635-9572-183f495429c4
104562026-03-03T18:55:13.724ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (10988660595257591748) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.690148224' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
104572026-03-03T18:55:13.724ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104582026-03-03T18:55:13.732ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 5 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104592026-03-03T18:55:13.732ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104602026-03-03T18:55:13.732ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = 913233fe-92a8-4635-9572-183f495429c4 producer_ip = 127.0.0.1 producer_port = 37169
104612026-03-03T18:55:13.732ZDEBGtest_instance_metrics (results-sink): inserting 17 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
104622026-03-03T18:55:13.732ZDEBGtest_instance_metrics (clickhouse-client): unrolling 17 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
104632026-03-03T18:55:13.738ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 34 sql = INSERT INTO oximeter.fields_string FORMAT Native
104642026-03-03T18:55:13.739ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 48727 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = 28fc1f01-4694-47b9-8f6d-763f1b5fa5db response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.690148224Z&order=descending&limit=1
104652026-03-03T18:55:13.739ZINFOtest_instance_metrics (external client test context): client received response status = 200
104662026-03-03T18:55:13.739ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
104672026-03-03T18:55:13.740ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 34 table_name = fields_string
104682026-03-03T18:55:13.740ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 17 sql = INSERT INTO oximeter.fields_u16 FORMAT Native
104692026-03-03T18:55:13.740ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
104702026-03-03T18:55:13.740ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
104712026-03-03T18:55:13.740ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
104722026-03-03T18:55:13.740ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
104732026-03-03T18:55:13.741ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104742026-03-03T18:55:13.741ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104752026-03-03T18:55:13.741ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104762026-03-03T18:55:13.744ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104772026-03-03T18:55:13.744ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104782026-03-03T18:55:13.744ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104792026-03-03T18:55:13.745ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 17 table_name = fields_u16
104802026-03-03T18:55:13.745ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 17 sql = INSERT INTO oximeter.fields_uuid FORMAT Native
104812026-03-03T18:55:13.747ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
104822026-03-03T18:55:13.747ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104832026-03-03T18:55:13.747ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104842026-03-03T18:55:13.747ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104852026-03-03T18:55:13.748ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104862026-03-03T18:55:13.750ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
104872026-03-03T18:55:13.750ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104882026-03-03T18:55:13.750ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104892026-03-03T18:55:13.750ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104902026-03-03T18:55:13.751ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 17 table_name = fields_uuid
104912026-03-03T18:55:13.751ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 19 n_rows = 17 sql = INSERT INTO oximeter.measurements_histogramu64 FORMAT Native
104922026-03-03T18:55:13.751ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
104932026-03-03T18:55:13.754ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
104942026-03-03T18:55:13.754ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
104952026-03-03T18:55:13.754ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
104962026-03-03T18:55:13.754ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
104972026-03-03T18:55:13.756ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
104982026-03-03T18:55:13.756ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
104992026-03-03T18:55:13.756ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105002026-03-03T18:55:13.756ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105012026-03-03T18:55:13.756ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105022026-03-03T18:55:13.757ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 17 table_name = measurements_histogramu64
105032026-03-03T18:55:13.757ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
105042026-03-03T18:55:13.758ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105052026-03-03T18:55:13.758ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105062026-03-03T18:55:13.758ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105072026-03-03T18:55:13.758ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105082026-03-03T18:55:13.762ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105092026-03-03T18:55:13.764ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
105102026-03-03T18:55:13.764ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105112026-03-03T18:55:13.764ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105122026-03-03T18:55:13.764ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105132026-03-03T18:55:13.764ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105142026-03-03T18:55:13.764ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105152026-03-03T18:55:13.765ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105162026-03-03T18:55:13.766ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105172026-03-03T18:55:13.766ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105182026-03-03T18:55:13.766ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105192026-03-03T18:55:13.767ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105202026-03-03T18:55:13.768ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105212026-03-03T18:55:13.769ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105222026-03-03T18:55:13.769ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105232026-03-03T18:55:13.769ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105242026-03-03T18:55:13.770ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105252026-03-03T18:55:13.771ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105262026-03-03T18:55:13.771ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105272026-03-03T18:55:13.771ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105282026-03-03T18:55:13.772ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105292026-03-03T18:55:13.772ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105302026-03-03T18:55:13.772ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105312026-03-03T18:55:13.772ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105322026-03-03T18:55:13.772ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105332026-03-03T18:55:13.774ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105342026-03-03T18:55:13.774ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105352026-03-03T18:55:13.774ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105362026-03-03T18:55:13.774ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105372026-03-03T18:55:13.775ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105382026-03-03T18:55:13.775ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105392026-03-03T18:55:13.775ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105402026-03-03T18:55:13.776ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105412026-03-03T18:55:13.777ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105422026-03-03T18:55:13.781ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105432026-03-03T18:55:13.781ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105442026-03-03T18:55:13.781ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105452026-03-03T18:55:13.781ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105462026-03-03T18:55:13.781ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105472026-03-03T18:55:13.781ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105482026-03-03T18:55:13.782ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105492026-03-03T18:55:13.783ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105502026-03-03T18:55:13.783ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105512026-03-03T18:55:13.783ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105522026-03-03T18:55:13.784ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105532026-03-03T18:55:13.786ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105542026-03-03T18:55:13.787ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
105552026-03-03T18:55:13.790ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (10855055105004541248) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.739815644' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
105562026-03-03T18:55:13.792ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 51349 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b078099c-3db2-4244-b729-d2d9d641834f response_code = 200 uri = /v1/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.739815644Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105572026-03-03T18:55:13.792ZINFOtest_instance_metrics (external client test context): client received response status = 200
105582026-03-03T18:55:13.792ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105592026-03-03T18:55:13.792ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105602026-03-03T18:55:13.792ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
105612026-03-03T18:55:13.792ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105622026-03-03T18:55:13.792ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105632026-03-03T18:55:13.792ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105642026-03-03T18:55:13.792ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105652026-03-03T18:55:13.793ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105662026-03-03T18:55:13.794ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105672026-03-03T18:55:13.794ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105682026-03-03T18:55:13.795ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105692026-03-03T18:55:13.796ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
105702026-03-03T18:55:13.796ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
105712026-03-03T18:55:13.796ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105722026-03-03T18:55:13.796ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105732026-03-03T18:55:13.796ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105742026-03-03T18:55:13.797ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105752026-03-03T18:55:13.797ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105762026-03-03T18:55:13.797ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105772026-03-03T18:55:13.798ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105782026-03-03T18:55:13.798ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105792026-03-03T18:55:13.800ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
105802026-03-03T18:55:13.800ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105812026-03-03T18:55:13.800ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105822026-03-03T18:55:13.801ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105832026-03-03T18:55:13.802ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
105842026-03-03T18:55:13.802ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
105852026-03-03T18:55:13.802ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105862026-03-03T18:55:13.802ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105872026-03-03T18:55:13.802ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105882026-03-03T18:55:13.803ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
105892026-03-03T18:55:13.803ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
105902026-03-03T18:55:13.803ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
105912026-03-03T18:55:13.803ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
105922026-03-03T18:55:13.804ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
105932026-03-03T18:55:13.806ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
105942026-03-03T18:55:13.806ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105952026-03-03T18:55:13.806ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105962026-03-03T18:55:13.806ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105972026-03-03T18:55:13.806ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105982026-03-03T18:55:13.806ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
105992026-03-03T18:55:13.806ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106002026-03-03T18:55:13.808ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106012026-03-03T18:55:13.808ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106022026-03-03T18:55:13.808ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106032026-03-03T18:55:13.808ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106042026-03-03T18:55:13.809ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106052026-03-03T18:55:13.811ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106062026-03-03T18:55:13.811ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106072026-03-03T18:55:13.811ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106082026-03-03T18:55:13.811ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106092026-03-03T18:55:13.812ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106102026-03-03T18:55:13.812ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106112026-03-03T18:55:13.812ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106122026-03-03T18:55:13.813ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106132026-03-03T18:55:13.813ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106142026-03-03T18:55:13.813ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106152026-03-03T18:55:13.813ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106162026-03-03T18:55:13.814ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106172026-03-03T18:55:13.814ZWARNtest_instance_metrics (results-sink-cluster): failed to insert some results into metric DB collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
106182026-03-03T18:55:13.814ZDEBGtest_instance_metrics (results-sink-cluster): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106192026-03-03T18:55:13.814ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106202026-03-03T18:55:13.814ZTRACtest_instance_metrics (collection-task): forwarded explicit request to collection task collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106212026-03-03T18:55:13.814ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106222026-03-03T18:55:13.814ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106232026-03-03T18:55:13.814ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106242026-03-03T18:55:13.814ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106252026-03-03T18:55:13.814ZDEBGtest_instance_metrics (collection-task): collection task received explicit request to collect collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106262026-03-03T18:55:13.814ZERROtest_instance_metrics (collection-task): collection task forced collection queue is full! This should never happen, and probably indicates a bug in your test code, such as calling `try_force_collect()` many times collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 file = oximeter/collector/src/collection_task.rs:730 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106272026-03-03T18:55:13.814ZDEBGtest_instance_metrics (collection-task): collecting from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106282026-03-03T18:55:13.815ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106292026-03-03T18:55:13.815ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106302026-03-03T18:55:13.815ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106312026-03-03T18:55:13.816ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106322026-03-03T18:55:13.816ZTRACtest_instance_metrics (collection-task): sent collection request to producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106332026-03-03T18:55:13.817ZDEBGtest_instance_metrics (collection-task): collected results from producer collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 n_results = 1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106342026-03-03T18:55:13.817ZTRACtest_instance_metrics (collection-task): forwarded results to main collection loop collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106352026-03-03T18:55:13.817ZTRACtest_instance_metrics (collection-task): top of inner collection loop, waiting for next request collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 producer_id = a6458b7d-87c3-4483-be96-854d814c20de producer_ip = ::1 producer_port = 42939
106362026-03-03T18:55:13.817ZDEBGtest_instance_metrics (results-sink): inserting 1 samples into database collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106372026-03-03T18:55:13.817ZDEBGtest_instance_metrics (clickhouse-client): unrolling 1 total samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee
106382026-03-03T18:55:13.817ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 2 sql = INSERT INTO oximeter.fields_string FORMAT Native
106392026-03-03T18:55:13.818ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106402026-03-03T18:55:13.818ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106412026-03-03T18:55:13.818ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106422026-03-03T18:55:13.819ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106432026-03-03T18:55:13.819ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 2 table_name = fields_string
106442026-03-03T18:55:13.819ZTRACtest_instance_metrics (clickhouse-client): inserting data collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_columns = 4 n_rows = 1 sql = INSERT INTO oximeter.measurements_i64 FORMAT Native
106452026-03-03T18:55:13.820ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106462026-03-03T18:55:13.824ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106472026-03-03T18:55:13.824ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106482026-03-03T18:55:13.824ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106492026-03-03T18:55:13.824ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106502026-03-03T18:55:13.824ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106512026-03-03T18:55:13.825ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106522026-03-03T18:55:13.825ZDEBGtest_instance_metrics (clickhouse-client): inserted rows into table collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1 id = aff96ec7-4765-46ac-b690-08a123ab22ee n_rows = 1 table_name = measurements_i64
106532026-03-03T18:55:13.825ZTRACtest_instance_metrics (results-sink): successfully inserted samples collector_id = 39e6175b-4df2-4730-b11d-cbc1e60a2e78 collector_ip = ::1
106542026-03-03T18:55:13.826ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106552026-03-03T18:55:13.826ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106562026-03-03T18:55:13.826ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106572026-03-03T18:55:13.827ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106582026-03-03T18:55:13.828ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106592026-03-03T18:55:13.830ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106602026-03-03T18:55:13.831ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:cpus_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
106612026-03-03T18:55:13.833ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:cpus_provisioned' AND timeseries_key IN (15918897146657644681) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.792451938' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
106622026-03-03T18:55:13.835ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 43117 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b4317cb5-6f80-4c07-8b02-4ff5eba20405 response_code = 200 uri = /v1/metrics/cpus_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.792451938Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106632026-03-03T18:55:13.836ZINFOtest_instance_metrics (external client test context): client received response status = 200
106642026-03-03T18:55:13.836ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106652026-03-03T18:55:13.836ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106662026-03-03T18:55:13.836ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7 version = 2026021900.0.0
106672026-03-03T18:55:13.836ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106682026-03-03T18:55:13.836ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
106692026-03-03T18:55:13.836ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106702026-03-03T18:55:13.836ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106712026-03-03T18:55:13.837ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106722026-03-03T18:55:13.838ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106732026-03-03T18:55:13.838ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106742026-03-03T18:55:13.839ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106752026-03-03T18:55:13.840ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
106762026-03-03T18:55:13.840ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
106772026-03-03T18:55:13.840ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106782026-03-03T18:55:13.840ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106792026-03-03T18:55:13.840ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106802026-03-03T18:55:13.841ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106812026-03-03T18:55:13.841ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106822026-03-03T18:55:13.841ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106832026-03-03T18:55:13.842ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106842026-03-03T18:55:13.843ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
106852026-03-03T18:55:13.845ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
106862026-03-03T18:55:13.845ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106872026-03-03T18:55:13.845ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106882026-03-03T18:55:13.845ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106892026-03-03T18:55:13.846ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
106902026-03-03T18:55:13.846ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
106912026-03-03T18:55:13.846ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106922026-03-03T18:55:13.846ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106932026-03-03T18:55:13.846ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106942026-03-03T18:55:13.847ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
106952026-03-03T18:55:13.847ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
106962026-03-03T18:55:13.847ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
106972026-03-03T18:55:13.848ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
106982026-03-03T18:55:13.849ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
106992026-03-03T18:55:13.850ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
107002026-03-03T18:55:13.850ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107012026-03-03T18:55:13.850ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107022026-03-03T18:55:13.850ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107032026-03-03T18:55:13.851ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107042026-03-03T18:55:13.851ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107052026-03-03T18:55:13.851ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107062026-03-03T18:55:13.852ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107072026-03-03T18:55:13.852ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107082026-03-03T18:55:13.852ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107092026-03-03T18:55:13.853ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107102026-03-03T18:55:13.854ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107112026-03-03T18:55:13.855ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107122026-03-03T18:55:13.855ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107132026-03-03T18:55:13.855ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107142026-03-03T18:55:13.856ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107152026-03-03T18:55:13.857ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107162026-03-03T18:55:13.857ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107172026-03-03T18:55:13.857ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107182026-03-03T18:55:13.858ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107192026-03-03T18:55:13.858ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = f04dd7b1-f806-4002-8222-cf99123d65c7 resource_type = Project silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107202026-03-03T18:55:13.858ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107212026-03-03T18:55:13.858ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107222026-03-03T18:55:13.858ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107232026-03-03T18:55:13.860ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107242026-03-03T18:55:13.860ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107252026-03-03T18:55:13.860ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107262026-03-03T18:55:13.860ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107272026-03-03T18:55:13.861ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107282026-03-03T18:55:13.861ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107292026-03-03T18:55:13.861ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107302026-03-03T18:55:13.861ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107312026-03-03T18:55:13.863ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107322026-03-03T18:55:13.867ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: f04dd7b1-f806-4002-8222-cf99123d65c7, lookup_type: ById(f04dd7b1-f806-4002-8222-cf99123d65c7) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107332026-03-03T18:55:13.867ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107342026-03-03T18:55:13.867ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107352026-03-03T18:55:13.867ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107362026-03-03T18:55:13.867ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107372026-03-03T18:55:13.867ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107382026-03-03T18:55:13.869ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107392026-03-03T18:55:13.869ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107402026-03-03T18:55:13.869ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107412026-03-03T18:55:13.869ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107422026-03-03T18:55:13.871ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin"), (Silo, 001de000-5110-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107432026-03-03T18:55:13.872ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107442026-03-03T18:55:13.874ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:ram_provisioned' AND field_name = 'id' AND field_value = 'f04dd7b1-f806-4002-8222-cf99123d65c7') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
107452026-03-03T18:55:13.879ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:ram_provisioned' AND timeseries_key IN (9666909797316088926) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.836172168' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
107462026-03-03T18:55:13.881ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 45140 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = d6f43016-05be-4c64-bde3-d2052c778ff9 response_code = 200 uri = /v1/metrics/ram_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.836172168Z&order=descending&limit=1&project=f04dd7b1-f806-4002-8222-cf99123d65c7
107472026-03-03T18:55:13.881ZINFOtest_instance_metrics (external client test context): client received response status = 200
107482026-03-03T18:55:13.882ZINFOtest_instance_metrics (external client test context): client request body = Body { inner: BoxBody } method = GET uri = http://127.0.0.1:36591/v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107492026-03-03T18:55:13.882ZTRACtest_instance_metrics (dropshot_external): incoming request local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107502026-03-03T18:55:13.882ZDEBGtest_instance_metrics (dropshot_external): determined request API version local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1 version = 2026021900.0.0
107512026-03-03T18:55:13.882ZTRACtest_instance_metrics (dropshot_external): authn: trying Spoof local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107522026-03-03T18:55:13.882ZDEBGtest_instance_metrics (dropshot_external): looking up silo for user local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 silo_user_id = 001de000-05e4-4000-8000-000000004007 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107532026-03-03T18:55:13.882ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107542026-03-03T18:55:13.882ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107552026-03-03T18:55:13.882ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107562026-03-03T18:55:13.884ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107572026-03-03T18:55:13.884ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107582026-03-03T18:55:13.884ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107592026-03-03T18:55:13.885ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) }
107602026-03-03T18:55:13.885ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107612026-03-03T18:55:13.885ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107622026-03-03T18:55:13.885ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107632026-03-03T18:55:13.886ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107642026-03-03T18:55:13.887ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107652026-03-03T18:55:13.887ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107662026-03-03T18:55:13.887ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107672026-03-03T18:55:13.887ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107682026-03-03T18:55:13.888ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
107692026-03-03T18:55:13.890ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }, key: 001de000-05e4-4000-8000-000000004007 (silo_user), lookup_type: ById(001de000-05e4-4000-8000-000000004007) } result = Ok(())
107702026-03-03T18:55:13.890ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107712026-03-03T18:55:13.890ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107722026-03-03T18:55:13.890ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107732026-03-03T18:55:13.891ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) }
107742026-03-03T18:55:13.891ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-5110-4000-8000-000000000000 resource_type = Silo
107752026-03-03T18:55:13.891ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107762026-03-03T18:55:13.891ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107772026-03-03T18:55:13.892ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107782026-03-03T18:55:13.892ZTRACtest_instance_metrics (ExternalAuthn): loading roles actor = Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. } resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet
107792026-03-03T18:55:13.892ZTRACtest_instance_metrics (ExternalAuthn): authorize begin action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database
107802026-03-03T18:55:13.892ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {} }
107812026-03-03T18:55:13.893ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Database result = Ok(())
107822026-03-03T18:55:13.894ZDEBGtest_instance_metrics (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
107832026-03-03T18:55:13.895ZDEBGtest_instance_metrics (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003 (built_in_user), .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000000, lookup_type: ById(001de000-5110-4000-8000-000000000000) } result = Ok(())
107842026-03-03T18:55:13.895ZTRACtest_instance_metrics (dropshot_external): authn result: Ok(Context { kind: Authenticated(Details { actor: Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }, device_token_expiration: None, credential_id: None }, Some(SiloAuthnPolicy { mapped_fleet_roles: {} })), schemes_tried: [Spoof] }) local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107852026-03-03T18:55:13.895ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107862026-03-03T18:55:13.896ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107872026-03-03T18:55:13.896ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107882026-03-03T18:55:13.896ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107892026-03-03T18:55:13.896ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107902026-03-03T18:55:13.897ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107912026-03-03T18:55:13.900ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107922026-03-03T18:55:13.900ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107932026-03-03T18:55:13.900ZTRACtest_instance_metrics (dropshot_external): loading roles actor = Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. } authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource_id = 001de000-1334-4000-8000-000000000000 resource_type = Fleet silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107942026-03-03T18:55:13.900ZTRACtest_instance_metrics (dropshot_external): authorize begin action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Database silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107952026-03-03T18:55:13.900ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 roles = RoleSet { roles: {} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107962026-03-03T18:55:13.900ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Database result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107972026-03-03T18:55:13.902ZDEBGtest_instance_metrics (dropshot_external): roles authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107982026-03-03T18:55:13.904ZDEBGtest_instance_metrics (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 001de000-05e4-4000-8000-000000004007 (silo_user), silo_id: 001de000-5110-4000-8000-000000000000, .. }) authenticated = true local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 resource = Fleet result = Ok(()) silo_id = 001de000-5110-4000-8000-000000000000 silo_user_id = 001de000-05e4-4000-8000-000000004007 type = silo_user uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
107992026-03-03T18:55:13.906ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT filter0.timeseries_key as timeseries_key, filter0.field_value AS id FROM (SELECT * FROM oximeter.fields_uuid WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND field_name = 'id' AND field_value = '001de000-1334-4000-8000-000000000000') AS filter0 ORDER BY (filter0.timeseries_name, filter0.timeseries_key)
108002026-03-03T18:55:13.908ZTRACtest_instance_metrics (clickhouse-client): executing SQL query id = 2f0f2b0a-2b47-4c7e-a2c5-69faf718b3a9 sql = SELECT * FROM oximeter.measurements_i64 WHERE timeseries_name = 'collection_target:virtual_disk_space_provisioned' AND timeseries_key IN (12379067900625785140) AND timestamp >= '2026-03-03 18:54:59.752229008' AND timestamp < '2026-03-03 18:55:13.881985521' ORDER BY (timeseries_name, timeseries_key, timestamp) DESC LIMIT 1
108012026-03-03T18:55:13.910ZINFOtest_instance_metrics (dropshot_external): request completed latency_us = 28335 local_addr = 127.0.0.1:36591 method = GET remote_addr = 127.0.0.1:46210 req_id = b83657d3-3fbc-4a81-b80e-b0b3a4a981f9 response_code = 200 uri = /v1/system/metrics/virtual_disk_space_provisioned?start_time=2026-03-03T18:54:59.752229008Z&end_time=2026-03-03T18:55:13.881985521Z&order=descending&limit=1
108022026-03-03T18:55:13.910ZINFOtest_instance_metrics (external client test context): client received response status = 200